WO2007091072A1 - System for measuring speed and/or position of a train - Google Patents

System for measuring speed and/or position of a train Download PDF

Info

Publication number
WO2007091072A1
WO2007091072A1 PCT/GB2007/000440 GB2007000440W WO2007091072A1 WO 2007091072 A1 WO2007091072 A1 WO 2007091072A1 GB 2007000440 W GB2007000440 W GB 2007000440W WO 2007091072 A1 WO2007091072 A1 WO 2007091072A1
Authority
WO
WIPO (PCT)
Prior art keywords
train
image
images
capture device
speed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2007/000440
Other languages
French (fr)
Inventor
Richard Shenton
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to EP07705171A priority Critical patent/EP1981748B1/en
Publication of WO2007091072A1 publication Critical patent/WO2007091072A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L25/00Recording or indicating positions or identities of vehicles or trains or setting of track apparatus
    • B61L25/02Indicating or recording positions or identities of vehicles or trains
    • B61L25/021Measuring and recording of train speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L25/00Recording or indicating positions or identities of vehicles or trains or setting of track apparatus
    • B61L25/02Indicating or recording positions or identities of vehicles or trains
    • B61L25/025Absolute localisation, e.g. providing geodetic coordinates
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L25/00Recording or indicating positions or identities of vehicles or trains or setting of track apparatus
    • B61L25/02Indicating or recording positions or identities of vehicles or trains
    • B61L25/026Relative localisation, e.g. using odometer
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P3/00Measuring linear or angular speed; Measuring differences of linear or angular speeds
    • G01P3/64Devices characterised by the determination of the time taken to traverse a fixed distance
    • G01P3/68Devices characterised by the determination of the time taken to traverse a fixed distance using optical means, i.e. using infrared, visible, or ultraviolet light
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B61RAILWAYS
    • B61LGUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
    • B61L2205/00Communication or navigation systems for railway traffic
    • B61L2205/04Satellite based navigation systems, e.g. global positioning system [GPS]
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits

Definitions

  • the present invention relates to a system for measuring the speed and/or position of a train.
  • ERTMS European Directive 98/48/EC on the interoperability of the trans-European high speed rail system. This aims to remove the need for colour light signals and associated infrastructure at the trackside, by communicating signalling information directly to the train by radio.
  • Initial implementations of new technology continue to use infrastructure based-train detection systems. These train detection systems, which use extensive cabling along the track, are prone to failure and are the cause of many train delays. They also constrain the capacity of the network.
  • a system for measuring train speed and position which uses an image capture device (one or multiple cameras) to take a sequence of timed images from the front or rear of the train.
  • the images are then analysed to determine train speed and position. By comparing the scenes from images taken a short time apart, the distance that the train has moved can be determined. The time the train takes to move the distance between the images is used to determine the train speed.
  • the images are also analysed to identify specific markers placed at the trackside at fixed known locations. When the system recognises that a particular marker has been passed, the position of the front or rear of the train is known. The markers can be used to correct built-up position and speed errors in the system and to provide sufficient certainty of position for safety critical operation of switches and crossings.
  • the invention also extends to a system for measuring train speed, and to a system for determining train position. If a rear-facing camera is incorporated into the system, then the system can be used to determine when the rear end of the train has passed a critical point (such as a switch or a crossing) by identifying the markers associated with that critical point when they appear in the field of view of the rear-facing camera. This information (that the rear of the train has passed the critical point) can be passed on to a control system, which may control the train or the infrastructure (points etc).
  • a critical point such as a switch or a crossing
  • trackside markers provides a low cost method of accurately and reliably determining the position of the train at switch, crossing and other important locations.
  • a battery-powered portable version of the unit can be used for rolling stock that is not appropriate for permanent fitment. For example, it can be mounted on the last wagon of a freight train.
  • an image capture device at the front of the train takes a sequence of images, and records the time at which each was taken.
  • the images are processed to recognise stationary objects (usually objects disposed between the rails) that are present in the images.
  • the change in position (and possibly size and orientation) of the objects between images is used to calculate the relative position of the camera or cameras when each image was captured, and thus the speed of the train.
  • the times at which the images were taken can be used to determine the train speed. For improved accuracy the system estimates the distance travelled along the rails, rather than the straight line distance between two points.
  • the system outputs the position and speed estimates for the train, with associated confidence measurements.
  • Information collected from the image analysis process is used continuously for camera and image calibration, eg height of the camera above the track, pointing angle, focal length, lens distortion, etc., and to ensure that the camera setting (such as height and pointing angle) have not changed. Similarly, it can be used to change camera settings (eg day/night or clear/mist conditions).
  • Markers can be placed at the side of the track, and these markers and any information encoded therein can be recognised by the system. When the system determines that it is passing these markers it can output this information to other systems. If the markers are at known positions, the location of the train can be determined.
  • the design of the markers should be such that they can be recognised in all environmental conditions. In addition, it is possible to uniquely identify which marker has been passed.
  • the design of the markers is sufficiently distinct that other objects cannot be mistakenly identified as markers.
  • the markers are in the form of 2D barcodes, which can be easily recognized as such and decoded by the image processor.
  • markers at the trackside There may be many markers at the trackside (eg to provide position information on different tracks or routes).
  • the system is designed so that position reports are only generated for markers that are directly relevant to the train. For example, identical markers can be positioned at either side of a particular track, and the system can be constrained to report only when it passes between two identical markers. If 2D barcodes are used, then a marker can encode whether it is relevant to the track to the left, to the track to the right, or both. It is also possible to limit the field of view of the camera so that it can only see markers directly to the left or right of the running track.
  • the markers placed on either side of the track can be designed so that the combination looks different from either side. This will allow the system to detect its direction of travel past the marker (ie whether the train is going 'up' or 'down' the track). If 2D barcodes are used, then this information can be encoded into them.
  • the system When a train passes the markers, the system outputs the identity of the markers and the time they were passed. To reduce 'dead reckoning 1 errors, the position of the train (determined as described above) is referenced to the last marker passed.
  • Specific markers can be used at critical points (such as switches and crossings) where it is important to know that the entire length of the train has cleared the critical point.
  • a rear-facing camera at the rear of the train can be used to capture images of the environment behind the train, and if these markers are identified in the images, then it can be determined that the rear of the train (and thus the entire length of the train) has passed the critical point. This information can be used in a train control system.
  • the system may be arranged so that a warning is given to a driver if the speed of the train is too great for its current position (for example, if it is approaching a bend too quickly).
  • the warning may also be passed on to a train control system.
  • Figure 1 is a schematic view of the system as it would be installed in the driver's cab of a train;
  • Figure 2 is a schematic view of the environment in front of the train when a first embodiment is used
  • Figure 3 is an image of the environment in front of the train when a second embodiment is used
  • Figure 4 shows a transformed version of the image shown in Figure 3;
  • Figure 5 shows the image of Figure 4, with horizontal and vertical strips used in speed detection highlighted; and
  • Figure 6 shows a 2D barcode.
  • the main components of the system are: - image capture device;
  • the image capture device 20, the image processor 30 and the train control interface 40 can all be provided in the driver's cab 10 as shown in Figure 1.
  • the image capture device captures images of the track ahead (or behind) the train, which images are used for speed, distance and position measurements.
  • the device is designed to work in all weather conditions including day, night, tunnel darkness, snow and fog.
  • the system can use generally available visible/near infra-red (IR) camera technology with a CCD detector in order to keep costs low and to ensure commercial availability of products.
  • IR visible/near infra-red
  • the cameras are capable of operating from bright sunlight down to very low light levels (eg 0.01 lux). This range may achieved by a switchable filter to adjust from day to night light levels (cf Sony camcorders with Night Shot capability).
  • the image size is about 780 x 500 pixels with frame rates in the region of 25-30 Hz.
  • the front- facing camera can be installed in the driver's cab of the train.
  • this can cause problems with IR cameras, as the windscreens of driver's cabs often have. IR cut-off filters.
  • monochrome visible light cameras which can operate down to 0.5 lux.
  • illumination is also required when inside tunnels.
  • Activation of the illumination device can be triggered either by an ambient light detector on the camera or directed by the processor unit.
  • the system can include a rear-facing camera, so that it can be determined whether the rear of the train has passed a particular point.
  • the rear carriage of a particular train may only be the rear carriage for that particular trip (for example, the rear carriage mat just be an ordinary freight wagon), and so a rear- facing camera should be provided in a removable unit, which can be attached to and detached from a carriage as necessary. It is convenient for such a unit to be battery- powered, and in order to reduce power consumption, the rear-facing camera should only operate when directed to do so.
  • the rate of image taking should be controlled by the processor unit, as this will be varied dependent on, for example, train speed, to achieve optimum results.
  • An accurate and dependable timer can be incorporated into the unit to record the time at which images are taken. Alternatively, it may be possible to simply rely on the frame rate of the camera.
  • Camera settings such as the focal length of the lens, may be controlled by the processor unit.
  • the image capture device is installed at the front (or back) of the train pointing forwards (or backwards) along the track.
  • the field of view of each camera can be such that the either side of the route is visible together with the tracks.
  • the horizon it is preferred for the horizon to be above or close to the top of the image.
  • Video from the image capture device is streamed to the image processor over the communication links.
  • Position markers mark specific points on the railway. They can be used as part of interlocking controls to control a train through switches and crossings. In addition, they can provide a position 'fix' to remove dead reckoning errors in the positioning system. Because they are used to precisely locate trains, they are important for safety.
  • the marker should be:
  • the markers can be identified by their shape. For example, readily identifiable shapes such as squares, triangles, circles, and so on can be used, and the marker can consist of a combination of shapes to distinguish it from other trackside objects such as signs. However, it is preferred for the markers to be in the form of 2D barcodes, and these will be described in detail later.
  • the markers should be placed sufficiently high above the ground to clear snow or flood water levels. Further, the markers should be designed to prevent them from being obscured by ice formation or snow deposits. For example, they can be thin and flat to avoid snow build-up and limit icicles.
  • the markers are recognisable for a train moving in either direction on the track.
  • the positioning system acts only on markers relevant to the track on which the train is running. If the markers on either side are distinguishable from each other, the direction of the train past the marker can be established.
  • the markers could be fixed horizontally either within the rails, or at the sides of the track, for example on platform walls.
  • the 'top' and 'bottom' of the marker are distinguishable in order to determine the direction of approach.
  • the markers may be labelled so that they are 'readable' by drivers or other personnel.
  • FIG. 2 shows the environment in front of a train where such markers are used.
  • the rails are schematically indicated at 60, and two markers are indicated at 70.
  • each marker consists of a sequence of shapes, formed from vertically-arranged flat plates fixed to a pole. The plates are mounted some distance above the ground, to clear snow or flood water levels. As the markers are vertically- arranged flat plates, snow will not build up on them.
  • the top and bottom plates are right isosceles triangles; these shapes are only used as the top and bottom of the marker, and the direction in which they point allows the system to determine whether the markers are being approached in an up or down direction.
  • top and bottom plates are three other plates of differing shapes, and the particular sequence of shapes is unique to this marker.
  • the system can recognize the shapes used, and thus identify the marker and so the position of the train.
  • the plates also have human-readable numbers marked on them.
  • measurement aids can be installed along a route to provide additional features to help the positioning system take speed and distance measurements. For example, they could be used on long featureless straight sections of track where there are few objects that the positioning system can recognise and track.
  • the imaging system For maximum benefit, and in particular for single-camera operation, it should be possible for the imaging system to scale the measurement aids.
  • the measurement aids can thus be of known size or linked to other features of known size.
  • the measurement aids are readily recognisable in all weather conditions and when approaching from either direction. Unlike position markers, the aids are not associated with a particular position on a specific track; they can therefore be installed at any convenient trackside location.
  • the image processor analyses the images received from the image capture device and determines train distance, speed and position information.
  • image processing functions There are many possible implementation options for the image processing functions and the following describes one particular approach based on a single camera in each image capture device. It should be appreciated that other approaches are possible. In particular, the use of stereoscopic cameras in each image capture device lessens many of the distance-based constraints of the single camera approach.
  • the image processor carries out the following functions:
  • the image processor is initialised with the camera parameters. For single camera operation, the camera must be calibrated such that the position of the optical centre in the image is known to the image processor, together with the angular separation that each pixel represents from the optical axis.
  • the image processor is also provided with initial information on the height of the camera, its pointing angle and the position of the 'Track Centre'.
  • the Track Centre is the point mid-point between the two straight running rails at the bottom of the image frame.
  • the image processor is also provided with information on the track gauge (standard distance between the running rails).
  • Low level processing of each frame takes place using standard image processing techniques to improve the usability of the image, for example, histogram equalization to increase brightness range in low brightness areas.
  • a corner detector is then used to identify potential points of interest in the image.
  • An example corner detector is provided by H P Moravec, Towards automatic visual obstacle avoidance, Proceedings of the 5th International Joint Conference on Artificial Intelligence, Carnegie-Mellon University Pittsburgh, PA August 1977. Those corners that are connected to motion are determined by differencing two or more images in the video stream.
  • the corner points are used in the analysis of tracking points and to search for position markers.
  • the pixel neighbourhoods of 'moving corners' are searched to determine whether these contain position markers.
  • the triangles that are used in position markers are sought first.
  • Straightforward triangle templates are used to match similar triangles in the image.
  • Two templates are used corresponding to the left and right pointing triangles in the position markers.
  • a triangle When a triangle is detected, it may correspond to the whole of the triangle in the position marker (or other object), or just the tip. Templates of increasing size are matched with the image to determine the size of the marker (or other object).
  • marker pairs are identified by two markers with the same identity.
  • the system reports that the train is passing the marker pair when both markers leave the field of view of the camera, one marker to the left hand side of the Track Centre (see above) and the other to the right hand side.
  • tracking points In the analysis of previous frames, tracking points have been identified and used to calculate train position and speed. In addition, points of interest in previous frames have been identified as potential tracking points.
  • the first step is to locate the position of previous tracking points in the current frame. From previous estimates of vehicle motion, the region of the current frame within which a tracking point is likely to be found can be estimated. Points of interest within the current frame are identified and the pixel neighbourhood around these points is matched with the pixel neighbourhood of the tracking point from previous frames. The best match is used as the location of the tracking point within the new frame. A similar process is used to look for the correspondence of potential tracking points from previous frames with the current frame. Once a potential tracking point has been located with sufficient confidence in successive frames, it can be designated as an actual tracking point that can be used for determination of train speed and position.
  • Points of interest that have no correspondence with actual or potential tracking points from previous frames can be designated as potential tracking points for future frames.
  • the tracking points are used to determine the motion of the train.
  • Each of the points in the real 3D world is mapped to a point on the 2D video frame.
  • the points also move position on the corresponding video frame.
  • the mapping between 3D world position and 2D frames is a projective geometry transformation.
  • the sequence of frames provides time and hence also velocity information.
  • the position of the tracking points in the real 3D world and the velocity of the train can be estimated by determining the transformation which best fit the tracked points in time and space. For more details see, for example, The Geometry of Multiple Images, Fuageras and Quang-Tuan Luong, MIT Press. Note that it is necessary to take account of other possible motion in the field of view, particularly passing trains.
  • the XY plane is defined as the plane containing the tracks (see below for how the position of the tracks is determined).
  • the direction of the X-axis can be set arbitrarily and could for example be in the direction of travel along a straight track section. Position information is calculated as the distance moved along the track and therefore the specific direction of X and Y-axes is unimportant.
  • Scale information is obtained from the track gauge (distance between the running rails). This information is provided to the system at initialisation. An explanation of how the track gauge is identified in the image frames will be given below.
  • the basic method to identify track position is to extract the image region around the track centre at the bottom of the image. As the top surfaces of the running rails are typically the brightest portions of this part of the image, the region is thresholded and then processed using a Hough transform to recover the intercept and gradient parameters of the main lines in the image.
  • the lines closest to the track centre are typically those of the inside edge of the running rail. However, the line information is filtered and correlated over time, so that short periods when switch and crossing rails or other rails and straight edges
  • tracking points associated with a particular point along the rails can be positioned in '3D'.
  • the point where a trackside marker meets the ground can be associated with the track point with which it is 'level' in the image.
  • tracking points that pass beneath the camera between the running rails can be assumed to be at track height and hence associated with the track at that 'level' in the image.
  • the 'real world 1 position of the tracking point from the camera can be determined by geometry.
  • a similar approach can be used for markers of a known size, without reference to the tracks.
  • the scale and co-ordinate axes can be defined.
  • a natural set of co-ordinates is for the track to lie in the XY plane with the Y axis set in the initial direction of motion.
  • the track information can also be used for calibration of the external and internal parameters of the cameras. As the tracks are parallel, they converge at the
  • the vanishing point in the projected image.
  • the vanishing point can be used in determining the pointing angle of a camera relative to the plane and direction of the tracks.
  • the track also provides data for the calibration of internal camera parameters. For more details see 'Image Processing, Analysis, and Machine Vision', Sonka, Hlavac, Boyle, PWS Publishing, 1999.
  • the projection transformation which maps the 3D world onto the 2D image captured by the camera is undone, to give an image which appears to look directly down onto the tracks.
  • the necessary information for this is contained within the track geometry.
  • the "vanishing point" (the point at which all parallel lines which run perpendicular to the image plane seem to converge) can be ascertained.
  • Figure 3 shows an image as captured by a camera of the environment in front of the train, showing how the parallel lines of the rails seem to converge.
  • image B shown in Figure 4
  • the speed of the train is then estimated using optical flow. This is a standard technique for deriving the motion of objects from the displacement of pixels through an image sequence.
  • the approach used in this embodiment estimates how a strip of pixels has moved between image frames. Multiple strips are used, to allow multiple measurements to be made from each frame. The results are statistically combined to give a motion estimate for each frame. The statistics of the multiple measurements also provide a quality or confidence measure of the speed estimate, which can be used in safety management.
  • the method can use strips which are horizontal or vertical in the image frame. Two such strips (one of each type) are shown in Figure 5. It has been found that there is enough "texture" in the ballast and in other objects in the track to allow the displacement of each strip from frame to frame to be determined.
  • the initial estimate of train speed is made in pixels per frame (for example, a horizontal strip moved down ten pixels from one frame to the next in images taken using a front-facing camera).
  • a calibration factor is then used to convert the number of pixels to the distance covered between frames.
  • the camera needs to be calibrated prior to use.
  • the essential calibration information is the field of view of the camera and the track gauge of the infrastructure, but alternative methods can be used).
  • the speed estimate can be refined to take account of track curvature and train suspension effects (causing motion of the camera relative to the track).
  • One approach to make these refinements is to use information on the pointing angle of the camera relative to the rails combined with geometrical principles. The position of the rails in Fig.
  • edges 4 can be extracted using a method similar to that described above for detecting the edges of the barcodes.
  • Each edge of the rail is detected with an edge detection filter and "edgelets" are identified.
  • Parallel edgelets with an appropriate separation are classified as rail candidates, and the other edgelets are discarded.
  • the remaining edgelets are connected into chains that identify the rails.
  • the speed of the train can be calculated from the (known) interval between frames.
  • a particularly preferred form of marker will now be described.
  • the markers described above had information encoded in them through their shapes. However, this has a number of limitations (not least in the amount of information that can be encoded), and so it is preferred to use 2D barcodes as markers.
  • FIG. 6 A suitable form of 2D barcode (the Datamatrix barcode) is shown in Figure 6, and the following description will be concerned with this type of 2D barcode. However, it will be appreciated that other forms of 2D barcode can be used.
  • the left and bottom edges of the Datamatrix 2D barcode have solid black bars, allowing the barcode to be located.
  • the right and top edges have a synchronization pattern of alternating black and white, which allows the module width and offset to be determined.
  • the black edges are detected.
  • the image is passed through a Sobel edge detection filter, and the edge image is filtered using a non- maximal suppression filter to accurately locate the position of the edge.
  • edge pixels which have an edge direction perpendicular to the run are located and identified as "edgelets”.
  • Straightness constraints are placed on these edgelets to avoid following edges around corners, and finding other curved images in the image. From the list of edgelets, pairs which could be used to describe the edges of a
  • Edgelets will be paired if they meet the following criteria:
  • the lines are defined as being from the point of intersection of the two lines (which may lie beyond the length of the identified edgelet) to the far end of either edgelet.
  • the edgelets may not cover the whole length of the border. Both edges are therefore allowed to grow away from the intersection point.
  • the average dot-product of the edge vector of each pixel under the line with a vector perpendicular to the line is calculated.
  • the line is allowed to extend so long as the equivalent dot-product of the next pixel is greater than one-quarter of the average value for the line.
  • the two edges describe two full sides of the Datamatrix barcode.
  • the shape of the barcode can then be taken as that of the parallelogram, described by the two edges (that is, the opposite sides are parallel).
  • Each Datamatrix barcode is then extracted from the image by resampling the parallelogram, to give a square 200 by 200 pixel image.
  • a bi-cubic interpolation routine is used to maintain a reasonable level of edge information, Also, the intensities across the image are normalized using locally calculated minimum and maximum values.
  • the extract Datamatrix can then be decoded to determine the unique marker information that it contains.
  • the image processor is analysing images from the correct image capture device.
  • the association between the two devices may change, eg if the processor is remote from the image capture device and a new rear device is added to a freight train (see below). In such cases, the reconfiguration should be straightforward to carry out and check.
  • a physical key can therefore be provided for each image capture device unit that can be inserted into the image processor to secure communications between the two devices.
  • Devices may be connected by cabled or wireless connections. Wireless connections are most likely to be required when providing train integrity for a freight train.
  • the rear device may be mounted on a wagon on which no power supply or other connection is available.
  • the image capture device may be mounted on the rear wagon, but the image processor may be installed in the locomotive where power is available.
  • a communications link can be provided to connect the two devices.
  • the link has sufficient bandwidth to send images to the image processor at the required rate (eg video rate).
  • the link is as low power as possible, commensurate with a high quality link over the length of the train.
  • Possible technologies are 'WiFi' (with extender units mounted on intermediate rolling stock where necessary) or emerging WiMAX technology.
  • the rear unit also carries out image processing, then a communications link with a wide bandwidth is not necessary, and the ZigBee standard can be used for data transmission.
  • the link must be easy to install and in order to be compatible with all vehicle types, the antennas for the link may be directed underneath the train.
  • the communications links should permit networked operation.
  • the communications system should be 'closed' by keys or similar devices, so that components of the positioning system only communicate with other components on the same train.
  • the train control interface unit provides the interface between the positioning system and a train control system that is using the positioning system for train detection.
  • the interface unit provides alarms to the train control system of any failure or warning conditions within the positioning system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Train Traffic Observation, Control, And Security (AREA)

Abstract

A system for determining the speed and the position of a train or a similar vehicle, comprises an image capture device, for mounting on the train in such a position that it can capture a sequence of images of the environment ahead of or behind the train, and an image processor, for processing the images captured by the image capture device. The image processor processes said sequence of images and derives the speed of the train from the apparent motion of objects in the images, and recognizes trackside markers, each of which uniquely identifies its position, thus deriving the position of the train from the identity of the marker. In a preferred form, the markers are 2D barcodes.

Description

SYSTEM FOR MEASURING SPEED AND/OR POSITION OF A TRAIN
The present invention relates to a system for measuring the speed and/or position of a train.
Most operational control systems currently in use with trains make use of fixed block signalling technology. When trains enter or leave fixed lengths of track (referred to as 'blocks'), they are detected by infrastructure-based systems such as track circuits or axle counters. The entry of the train into the block section is controlled by colour light signals. The technology is costly to install and maintain, and limits the capacity of the railway network (as only one train can typically be in a block section at any time, irrespective of train speed).
In Europe, much R&D effort has gone into a specifying a new generation of signal technology, particularly the European Rail Traffic Management System
(ERTMS) defined under the European Directive 98/48/EC on the interoperability of the trans-European high speed rail system. This aims to remove the need for colour light signals and associated infrastructure at the trackside, by communicating signalling information directly to the train by radio. Initial implementations of new technology continue to use infrastructure based-train detection systems. These train detection systems, which use extensive cabling along the track, are prone to failure and are the cause of many train delays. They also constrain the capacity of the network.
Replacing infrastructure-based train detection by train-based systems offers the opportunity for significantly greater benefits to be realised at lower cost. Different technologies are being developed for such train-based detection and location systems. To determine precise location at a particular point, 'balises' placed in the track are detected by transponders mounted under a train. Doppler radar systems are used to measure speed. Distance is measured using the train odometer. This variety of different systems adds to system cost and complexity. GPS technology is being investigated as a lower cost approach, but this has its limitations in deep cuttings and tunnels. According to a first broad general aspect of the invention, there is provided a system for measuring train speed and position which uses an image capture device (one or multiple cameras) to take a sequence of timed images from the front or rear of the train. The images are then analysed to determine train speed and position. By comparing the scenes from images taken a short time apart, the distance that the train has moved can be determined. The time the train takes to move the distance between the images is used to determine the train speed. The images are also analysed to identify specific markers placed at the trackside at fixed known locations. When the system recognises that a particular marker has been passed, the position of the front or rear of the train is known. The markers can be used to correct built-up position and speed errors in the system and to provide sufficient certainty of position for safety critical operation of switches and crossings.
The invention also extends to a system for measuring train speed, and to a system for determining train position. If a rear-facing camera is incorporated into the system, then the system can be used to determine when the rear end of the train has passed a critical point (such as a switch or a crossing) by identifying the markers associated with that critical point when they appear in the field of view of the rear-facing camera. This information (that the rear of the train has passed the critical point) can be passed on to a control system, which may control the train or the infrastructure (points etc). The various aspects of the invention allow a single system to provide the capability for train-based measurement of train speed and position. The use of trackside markers provides a low cost method of accurately and reliably determining the position of the train at switch, crossing and other important locations. A battery-powered portable version of the unit can be used for rolling stock that is not appropriate for permanent fitment. For example, it can be mounted on the last wagon of a freight train.
Before a specific description of the system and its components, the use of the system to determine train speed and position will be described. In order to determine the speed of the train, an image capture device at the front of the train takes a sequence of images, and records the time at which each was taken. The images are processed to recognise stationary objects (usually objects disposed between the rails) that are present in the images. The change in position (and possibly size and orientation) of the objects between images is used to calculate the relative position of the camera or cameras when each image was captured, and thus the speed of the train. Once the change in camera position between images is known, the times at which the images were taken can be used to determine the train speed. For improved accuracy the system estimates the distance travelled along the rails, rather than the straight line distance between two points.
The system outputs the position and speed estimates for the train, with associated confidence measurements.
Information collected from the image analysis process is used continuously for camera and image calibration, eg height of the camera above the track, pointing angle, focal length, lens distortion, etc., and to ensure that the camera setting (such as height and pointing angle) have not changed. Similarly, it can be used to change camera settings (eg day/night or clear/mist conditions).
Markers can be placed at the side of the track, and these markers and any information encoded therein can be recognised by the system. When the system determines that it is passing these markers it can output this information to other systems. If the markers are at known positions, the location of the train can be determined.
The design of the markers should be such that they can be recognised in all environmental conditions. In addition, it is possible to uniquely identify which marker has been passed. The design of the markers is sufficiently distinct that other objects cannot be mistakenly identified as markers. In a preferred form, the markers are in the form of 2D barcodes, which can be easily recognized as such and decoded by the image processor.
There may be many markers at the trackside (eg to provide position information on different tracks or routes). The system is designed so that position reports are only generated for markers that are directly relevant to the train. For example, identical markers can be positioned at either side of a particular track, and the system can be constrained to report only when it passes between two identical markers. If 2D barcodes are used, then a marker can encode whether it is relevant to the track to the left, to the track to the right, or both. It is also possible to limit the field of view of the camera so that it can only see markers directly to the left or right of the running track.
The markers placed on either side of the track can be designed so that the combination looks different from either side. This will allow the system to detect its direction of travel past the marker (ie whether the train is going 'up' or 'down' the track). If 2D barcodes are used, then this information can be encoded into them.
When a train passes the markers, the system outputs the identity of the markers and the time they were passed. To reduce 'dead reckoning1 errors, the position of the train (determined as described above) is referenced to the last marker passed.
Specific markers can be used at critical points (such as switches and crossings) where it is important to know that the entire length of the train has cleared the critical point. A rear-facing camera at the rear of the train can be used to capture images of the environment behind the train, and if these markers are identified in the images, then it can be determined that the rear of the train (and thus the entire length of the train) has passed the critical point. This information can be used in a train control system.
Further, the system may be arranged so that a warning is given to a driver if the speed of the train is too great for its current position (for example, if it is approaching a bend too quickly). The warning may also be passed on to a train control system.
Specific embodiments of the system and its components will now be described with reference to the accompanying drawings, in which: Figure 1 is a schematic view of the system as it would be installed in the driver's cab of a train;
Figure 2 is a schematic view of the environment in front of the train when a first embodiment is used;
Figure 3 is an image of the environment in front of the train when a second embodiment is used;
Figure 4 shows a transformed version of the image shown in Figure 3; Figure 5 shows the image of Figure 4, with horizontal and vertical strips used in speed detection highlighted; and Figure 6 shows a 2D barcode. The main components of the system are: - image capture device;
- trackside markers;
- image processor; and
- train control interface.
The image capture device 20, the image processor 30 and the train control interface 40 can all be provided in the driver's cab 10 as shown in Figure 1.
The image capture device captures images of the track ahead (or behind) the train, which images are used for speed, distance and position measurements. The device is designed to work in all weather conditions including day, night, tunnel darkness, snow and fog. The system can use generally available visible/near infra-red (IR) camera technology with a CCD detector in order to keep costs low and to ensure commercial availability of products. The cameras are capable of operating from bright sunlight down to very low light levels (eg 0.01 lux). This range may achieved by a switchable filter to adjust from day to night light levels (cf Sony camcorders with Night Shot capability). The image size is about 780 x 500 pixels with frame rates in the region of 25-30 Hz.
In a preferred form, the front- facing camera can be installed in the driver's cab of the train. However, this can cause problems with IR cameras, as the windscreens of driver's cabs often have. IR cut-off filters. Thus, it is currently preferred to use monochrome visible light cameras, which can operate down to 0.5 lux.
This will give some night-time capability, but it is preferred for additional night-time illumination to be provided to give sufficient viewing range. Train headlights will provide visible illumination in the forward direction, but tail lamps will not provide sufficient power in the rear direction. Providing strong visible illumination at the rear of the train may cause confusion as to which is the front and rear of the train and introduce safety hazards. Thus, the rear of the train may use day/night IR cameras and IR illumination, which is invisible to the human eye.
In addition to night-time operation, illumination is also required when inside tunnels. Activation of the illumination device can be triggered either by an ambient light detector on the camera or directed by the processor unit.
As mentioned above, the system can include a rear-facing camera, so that it can be determined whether the rear of the train has passed a particular point. The rear carriage of a particular train may only be the rear carriage for that particular trip (for example, the rear carriage mat just be an ordinary freight wagon), and so a rear- facing camera should be provided in a removable unit, which can be attached to and detached from a carriage as necessary. It is convenient for such a unit to be battery- powered, and in order to reduce power consumption, the rear-facing camera should only operate when directed to do so. Furthermore, the rate of image taking should be controlled by the processor unit, as this will be varied dependent on, for example, train speed, to achieve optimum results.
An accurate and dependable timer can be incorporated into the unit to record the time at which images are taken. Alternatively, it may be possible to simply rely on the frame rate of the camera.
Camera settings, such as the focal length of the lens, may be controlled by the processor unit.
The image capture device is installed at the front (or back) of the train pointing forwards (or backwards) along the track. The field of view of each camera can be such that the either side of the route is visible together with the tracks. However, in order to maximize visibility of the tracks (especially in tunnels, where the glare from the tunnel mouth can adversely affect the camera setting), it is preferred for the horizon to be above or close to the top of the image.
Video from the image capture device is streamed to the image processor over the communication links.
Position markers mark specific points on the railway. They can be used as part of interlocking controls to control a train through switches and crossings. In addition, they can provide a position 'fix' to remove dead reckoning errors in the positioning system. Because they are used to precisely locate trains, they are important for safety. The marker should be:
- easily recognisable by the positioning system in all conditions;
- distinguishable from other trackside objects; - uniquely identifiable (ie not confused with other positioning markers); and
- at a fixed known location.
As the positioning system is based on images, it is possible for the markers to be identified by their shape. For example, readily identifiable shapes such as squares, triangles, circles, and so on can be used, and the marker can consist of a combination of shapes to distinguish it from other trackside objects such as signs. However, it is preferred for the markers to be in the form of 2D barcodes, and these will be described in detail later.
The markers should be placed sufficiently high above the ground to clear snow or flood water levels. Further, the markers should be designed to prevent them from being obscured by ice formation or snow deposits. For example, they can be thin and flat to avoid snow build-up and limit icicles.
The markers are recognisable for a train moving in either direction on the track. By having a marker either side of the track, the positioning system acts only on markers relevant to the track on which the train is running. If the markers on either side are distinguishable from each other, the direction of the train past the marker can be established.
On occasions, there may not be sufficient clearance to position the markers either side of the track. In this case the markers could be fixed horizontally either within the rails, or at the sides of the track, for example on platform walls. The 'top' and 'bottom' of the marker are distinguishable in order to determine the direction of approach.
The markers may be labelled so that they are 'readable' by drivers or other personnel.
Figure 2 shows the environment in front of a train where such markers are used. The rails are schematically indicated at 60, and two markers are indicated at 70. As can be seen, each marker consists of a sequence of shapes, formed from vertically-arranged flat plates fixed to a pole. The plates are mounted some distance above the ground, to clear snow or flood water levels. As the markers are vertically- arranged flat plates, snow will not build up on them. In this embodiment, the top and bottom plates are right isosceles triangles; these shapes are only used as the top and bottom of the marker, and the direction in which they point allows the system to determine whether the markers are being approached in an up or down direction.
Between the top and bottom plates are three other plates of differing shapes, and the particular sequence of shapes is unique to this marker. The system can recognize the shapes used, and thus identify the marker and so the position of the train. The plates also have human-readable numbers marked on them.
Further, measurement aids can be installed along a route to provide additional features to help the positioning system take speed and distance measurements. For example, they could be used on long featureless straight sections of track where there are few objects that the positioning system can recognise and track.
For maximum benefit, and in particular for single-camera operation, it should be possible for the imaging system to scale the measurement aids. The measurement aids can thus be of known size or linked to other features of known size.
For maximum benefit, the measurement aids are readily recognisable in all weather conditions and when approaching from either direction. Unlike position markers, the aids are not associated with a particular position on a specific track; they can therefore be installed at any convenient trackside location.
The image processor analyses the images received from the image capture device and determines train distance, speed and position information. There are many possible implementation options for the image processing functions and the following describes one particular approach based on a single camera in each image capture device. It should be appreciated that other approaches are possible. In particular, the use of stereoscopic cameras in each image capture device lessens many of the distance-based constraints of the single camera approach. The image processor carries out the following functions:
- low level processing of each frame;
- identification of points of interest in each frame;
- search for position markers; - search for previous tracking points or new potential tracking points;
- motion analysis; and
- determination of track position and gauge.
Once installed in the train the image processor is initialised with the camera parameters. For single camera operation, the camera must be calibrated such that the position of the optical centre in the image is known to the image processor, together with the angular separation that each pixel represents from the optical axis. The image processor is also provided with initial information on the height of the camera, its pointing angle and the position of the 'Track Centre'. The Track Centre is the point mid-point between the two straight running rails at the bottom of the image frame. The image processor is also provided with information on the track gauge (standard distance between the running rails).
Low level processing of each frame takes place using standard image processing techniques to improve the usability of the image, for example, histogram equalization to increase brightness range in low brightness areas. A corner detector is then used to identify potential points of interest in the image. An example corner detector is provided by H P Moravec, Towards automatic visual obstacle avoidance, Proceedings of the 5th International Joint Conference on Artificial Intelligence, Carnegie-Mellon University Pittsburgh, PA August 1977. Those corners that are connected to motion are determined by differencing two or more images in the video stream.
The corner points are used in the analysis of tracking points and to search for position markers.
The pixel neighbourhoods of 'moving corners' are searched to determine whether these contain position markers. The triangles that are used in position markers are sought first. Straightforward triangle templates are used to match similar triangles in the image. Two templates are used corresponding to the left and right pointing triangles in the position markers.
When a triangle is detected, it may correspond to the whole of the triangle in the position marker (or other object), or just the tip. Templates of increasing size are matched with the image to determine the size of the marker (or other object).
Vertically mounted markers are detected when there are two triangles of the same size located one above the other in the vertical direction. The image between the two triangles is then examined to identify other components of the marker. This again uses simple matching techniques for appropriately scaled templates of circles, squares etc.
If all the marker components are detected with sufficient confidence, the marker itself is detected and its identity is determined. Marker pairs are identified by two markers with the same identity.
The system reports that the train is passing the marker pair when both markers leave the field of view of the camera, one marker to the left hand side of the Track Centre (see above) and the other to the right hand side.
The above approach for vertically mounted markers is used similarly for horizontally mounted markers, with the necessary adjustments for marker positioning and geometry. The 'moving corners' in each frame are used in the tracking process. When one of these points of interest is used to determine train position and speed it is termed a tracking point.
In the analysis of previous frames, tracking points have been identified and used to calculate train position and speed. In addition, points of interest in previous frames have been identified as potential tracking points.
The first step is to locate the position of previous tracking points in the current frame. From previous estimates of vehicle motion, the region of the current frame within which a tracking point is likely to be found can be estimated. Points of interest within the current frame are identified and the pixel neighbourhood around these points is matched with the pixel neighbourhood of the tracking point from previous frames. The best match is used as the location of the tracking point within the new frame. A similar process is used to look for the correspondence of potential tracking points from previous frames with the current frame. Once a potential tracking point has been located with sufficient confidence in successive frames, it can be designated as an actual tracking point that can be used for determination of train speed and position.
Points of interest that have no correspondence with actual or potential tracking points from previous frames can be designated as potential tracking points for future frames.
The tracking points are used to determine the motion of the train. Each of the points in the real 3D world is mapped to a point on the 2D video frame. As the train moves the position of the 3D points relative to the train changes, dependent on the train's velocity. The points also move position on the corresponding video frame.
The mapping between 3D world position and 2D frames is a projective geometry transformation. The sequence of frames provides time and hence also velocity information. The position of the tracking points in the real 3D world and the velocity of the train can be estimated by determining the transformation which best fit the tracked points in time and space. For more details see, for example, The Geometry of Multiple Images, Fuageras and Quang-Tuan Luong, MIT Press. Note that it is necessary to take account of other possible motion in the field of view, particularly passing trains.
Only the relative positioning of the tracking points can be ascertained by this approach. To determine 'real world' positions, real scale and co-ordinate axis information need to be provided. This information can be derived from the image of the track in the video frame.
The XY plane is defined as the plane containing the tracks (see below for how the position of the tracks is determined). The direction of the X-axis can be set arbitrarily and could for example be in the direction of travel along a straight track section. Position information is calculated as the distance moved along the track and therefore the specific direction of X and Y-axes is unimportant.
Scale information is obtained from the track gauge (distance between the running rails). This information is provided to the system at initialisation. An explanation of how the track gauge is identified in the image frames will be given below.
The basic method to identify track position is to extract the image region around the track centre at the bottom of the image. As the top surfaces of the running rails are typically the brightest portions of this part of the image, the region is thresholded and then processed using a Hough transform to recover the intercept and gradient parameters of the main lines in the image.
The lines closest to the track centre are typically those of the inside edge of the running rail. However, the line information is filtered and correlated over time, so that short periods when switch and crossing rails or other rails and straight edges
(eg from shadows) are found between the running rails do not result in these objects being mistakenly identified as running rails.
Once the running rails are identified, tracking points associated with a particular point along the rails can be positioned in '3D'. For example, the point where a trackside marker meets the ground can be associated with the track point with which it is 'level' in the image. In the absence of any trackside markers, tracking points that pass beneath the camera between the running rails can be assumed to be at track height and hence associated with the track at that 'level' in the image. Using the height of the camera, its pointing angle and knowledge of the angular distance of the tracking points from the optical centre, the 'real world1 position of the tracking point from the camera can be determined by geometry. A similar approach can be used for markers of a known size, without reference to the tracks.
Once the tracking points are located in 3D, the scale and co-ordinate axes can be defined. A natural set of co-ordinates is for the track to lie in the XY plane with the Y axis set in the initial direction of motion.
The track information can also be used for calibration of the external and internal parameters of the cameras. As the tracks are parallel, they converge at the
'vanishing point' in the projected image. In general, the vanishing point can be used in determining the pointing angle of a camera relative to the plane and direction of the tracks. The track also provides data for the calibration of internal camera parameters. For more details see 'Image Processing, Analysis, and Machine Vision', Sonka, Hlavac, Boyle, PWS Publishing, 1999.
A second, and presently preferred, embodiment will now be described. It has been found that reliably identifying and tracking 3D points, as described above, is computationally intensive, and so in a preferred method, the speed is derived from images of the track bed.
As a first step, the projection transformation which maps the 3D world onto the 2D image captured by the camera is undone, to give an image which appears to look directly down onto the tracks. The necessary information for this is contained within the track geometry. In particular, the "vanishing point" (the point at which all parallel lines which run perpendicular to the image plane seem to converge) can be ascertained.
Figure 3 shows an image as captured by a camera of the environment in front of the train, showing how the parallel lines of the rails seem to converge. (A similar image, of the environment at the rear of the train, could be captured using a rear- facing camera; the direction in which the camera faces is immaterial). Using this information, the part of the image A bounded by the thick black lines can be transformed into image B (shown in Figure 4), which appears to look down on the tracks. It is less computationally intensive to work on 2D images such as those of the type shown in Figure 4.
The speed of the train is then estimated using optical flow. This is a standard technique for deriving the motion of objects from the displacement of pixels through an image sequence.
The approach used in this embodiment estimates how a strip of pixels has moved between image frames. Multiple strips are used, to allow multiple measurements to be made from each frame. The results are statistically combined to give a motion estimate for each frame. The statistics of the multiple measurements also provide a quality or confidence measure of the speed estimate, which can be used in safety management. The method can use strips which are horizontal or vertical in the image frame. Two such strips (one of each type) are shown in Figure 5. It has been found that there is enough "texture" in the ballast and in other objects in the track to allow the displacement of each strip from frame to frame to be determined.
The initial estimate of train speed is made in pixels per frame (for example, a horizontal strip moved down ten pixels from one frame to the next in images taken using a front-facing camera). A calibration factor is then used to convert the number of pixels to the distance covered between frames. To obtain this factor, the camera needs to be calibrated prior to use. The essential calibration information is the field of view of the camera and the track gauge of the infrastructure, but alternative methods can be used). For improved accuracy, the speed estimate can be refined to take account of track curvature and train suspension effects (causing motion of the camera relative to the track). One approach to make these refinements is to use information on the pointing angle of the camera relative to the rails combined with geometrical principles. The position of the rails in Fig. 4 can be extracted using a method similar to that described above for detecting the edges of the barcodes. Each edge of the rail is detected with an edge detection filter and "edgelets" are identified. Parallel edgelets with an appropriate separation are classified as rail candidates, and the other edgelets are discarded. The remaining edgelets are connected into chains that identify the rails. Once the distance covered by the train between frames is known, the speed of the train can be calculated from the (known) interval between frames. A particularly preferred form of marker will now be described. The markers described above had information encoded in them through their shapes. However, this has a number of limitations (not least in the amount of information that can be encoded), and so it is preferred to use 2D barcodes as markers. A suitable form of 2D barcode (the Datamatrix barcode) is shown in Figure 6, and the following description will be concerned with this type of 2D barcode. However, it will be appreciated that other forms of 2D barcode can be used. The left and bottom edges of the Datamatrix 2D barcode have solid black bars, allowing the barcode to be located. The right and top edges have a synchronization pattern of alternating black and white, which allows the module width and offset to be determined.
To identify the barcode, the black edges are detected. The image is passed through a Sobel edge detection filter, and the edge image is filtered using a non- maximal suppression filter to accurately locate the position of the edge.
Straight runs of edge pixels which have an edge direction perpendicular to the run are located and identified as "edgelets". Straightness constraints are placed on these edgelets to avoid following edges around corners, and finding other curved images in the image. From the list of edgelets, pairs which could be used to describe the edges of a
Datamatrix barcode are sought. Edgelets will be paired if they meet the following criteria:
- they are within 22.5° of being perpendicular;
- the separation between their centres is no more that 85 pixels; - a point of intersection between the continuation of both lines is not within the centre 60% of either edgelet;
- the centre of the each edgelet form the point of intersection is more than 60 pixels; and
- the gradient of the intensity edges associated with both edgelets is decreasing (ie white to black) in the direction of the included angle.
Once candidate pairs of edgelets have been found, the lines are defined as being from the point of intersection of the two lines (which may lie beyond the length of the identified edgelet) to the far end of either edgelet. The edgelets may not cover the whole length of the border. Both edges are therefore allowed to grow away from the intersection point. The average dot-product of the edge vector of each pixel under the line with a vector perpendicular to the line is calculated. The line is allowed to extend so long as the equivalent dot-product of the next pixel is greater than one-quarter of the average value for the line. Typically, by the end of this step, the two edges describe two full sides of the Datamatrix barcode. The shape of the barcode can then be taken as that of the parallelogram, described by the two edges (that is, the opposite sides are parallel). Each Datamatrix barcode is then extracted from the image by resampling the parallelogram, to give a square 200 by 200 pixel image. A bi-cubic interpolation routine is used to maintain a reasonable level of edge information, Also, the intensities across the image are normalized using locally calculated minimum and maximum values.
The extract Datamatrix can then be decoded to determine the unique marker information that it contains.
It is important that the image processor is analysing images from the correct image capture device. The association between the two devices may change, eg if the processor is remote from the image capture device and a new rear device is added to a freight train (see below). In such cases, the reconfiguration should be straightforward to carry out and check. A physical key can therefore be provided for each image capture device unit that can be inserted into the image processor to secure communications between the two devices.
Devices may be connected by cabled or wireless connections. Wireless connections are most likely to be required when providing train integrity for a freight train. In this case, the rear device may be mounted on a wagon on which no power supply or other connection is available. To maximise battery life, the image capture device may be mounted on the rear wagon, but the image processor may be installed in the locomotive where power is available.
A communications link can be provided to connect the two devices. The link has sufficient bandwidth to send images to the image processor at the required rate (eg video rate). The link is as low power as possible, commensurate with a high quality link over the length of the train. Possible technologies are 'WiFi' (with extender units mounted on intermediate rolling stock where necessary) or emerging WiMAX technology. Alternatively, if the rear unit also carries out image processing, then a communications link with a wide bandwidth is not necessary, and the ZigBee standard can be used for data transmission.
The link must be easy to install and in order to be compatible with all vehicle types, the antennas for the link may be directed underneath the train. To support the communication of different components of the positioning system, the communications links should permit networked operation. The communications system should be 'closed' by keys or similar devices, so that components of the positioning system only communicate with other components on the same train.
The train control interface unit provides the interface between the positioning system and a train control system that is using the positioning system for train detection.
It takes the input from image processor units and reports distance, speed, position and time error estimates to the train control' system. It receives requests from the train control system for updates and also receives instructions to change system parameters (eg reporting frequency).
The interface unit provides alarms to the train control system of any failure or warning conditions within the positioning system.

Claims

1. A system for determining the speed and/or position of a train or a similar vehicle, comprising: an image capture device, for mounting on the train in such a position that it can capture a sequence of images of the environment ahead of or behind the train; and an image processor, for processing the images captured by the image capture device, wherein the image processor processes said sequence of images and derives the speed of the train from the apparent motion of objects in the images.
2. A system as claimed in claim 1 , wherein the time at which each image in the sequence is captured is recorded, and the speed of the train is determined based on the time between images.
3. A system as claimed in claim 1 or claim 2, wherein the image processor transforms each captured image of the environment ahead of the train to give an image looking down on the tracks, and uses these transformed images to derive the speed of the train.
4. A system as claimed in claim 3, wherein the image processor derives the speed of the train by measuring how far (in pixels) a strip of pixels has moved from one transformed image to the next, calculating the distance moved per frame using a preset calibration factor for converting pixels into distance, and calculating the speed of the train using the time interval between frames.
5. A system as claimed in any preceding claim, wherein information about the track (such as the position of the rails) is extracted from the images by the image processor, and used to measure camera parameters, which can in turn be used to refine the speed estimate.
6. A system as claimed in any preceding claim, wherein the image processor also recognizes trackside markers, each of which uniquely identifies its position, thus deriving the position of the train from the identity of the marker.
7. A system for determining the speed and/or position of a train or a similar vehicle, comprising: an image capture device, for mounting on the train in such a position that it can capture a sequence of images of the environment ahead of or behind the train; and an image processor, for processing the images captured by the image capture device, wherein the image processor recognizes trackside markers, each of which uniquely identifies its position, thus deriving the position of the train from the identity of the marker.
8. A system as claimed in claim 6 or claim 7, wherein the position of the marker is uniquely identified by its appearance, which is analyzed by the image processor.
9. A system as claimed in claim 8, wherein the markers are in the form of 2D barcodes, such as Datamatrix barcodes.
10 A system as claimed in any of claims 6 to 9, wherein the current position of the train is calculated based on the speed of the train and the position of the last marker passed.
11. A system as claimed in any preceding claim, comprising a front image capture device and a rear image capture image device, which allow images of the environments in front of and behind the train to be captured.
12. A system as claimed in claim 11, wherein a single image processor associated with the front image capture device is used to process the images from the front image capture device and the rear image capture device, the rear image capture device being in communication with the image processor.
13. A system as claimed in claim 11 or claim 12, wherein the position of the rear of train is used for train or infrastructure control.
14. A system as claimed in any of claims 11 to 13, wherein the rear image capture device is battery-powered.
15. A system as claimed in claim 12, wherein said rear image capture device is controlled from the front of the train to only capture images when instructed to do so.
16. A system as claimed in any of claims 11 to 15, wherein said rear image capture device is security-keyed to said front image capture device.
17. A system as claimed in any preceding claim, additionally comprising a train control interface, for reporting speed, position etc to a train control system.
18. A train on which a system as claimed in any preceding claim is installed.
PCT/GB2007/000440 2006-02-07 2007-02-07 System for measuring speed and/or position of a train Ceased WO2007091072A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP07705171A EP1981748B1 (en) 2006-02-07 2007-02-07 System for measuring speed of a train

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0602448.3 2006-02-07
GB0602448A GB0602448D0 (en) 2006-02-07 2006-02-07 System For Train Speed, Position And Integrity Measurement

Publications (1)

Publication Number Publication Date
WO2007091072A1 true WO2007091072A1 (en) 2007-08-16

Family

ID=36119648

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2007/000440 Ceased WO2007091072A1 (en) 2006-02-07 2007-02-07 System for measuring speed and/or position of a train

Country Status (3)

Country Link
EP (1) EP1981748B1 (en)
GB (1) GB0602448D0 (en)
WO (1) WO2007091072A1 (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2037224A1 (en) * 2007-09-12 2009-03-18 Pepperl + Fuchs Gmbh Method and device for determining the position of a vehicle, computer program and computer program product
WO2009150086A1 (en) * 2008-06-13 2009-12-17 Siemens Aktiengesellschaft Device and method for generating a locating signal
WO2012168424A1 (en) * 2011-06-09 2012-12-13 POSIVIZ Jean-Luc DESBORDES Device for measuring speed and position of a vehicle moving along a guidance track, method and computer program product corresponding thereto
RU2518078C1 (en) * 2013-01-25 2014-06-10 Владимир Всеволодович Разевиг Optical method for railway train speed determination
RU2564295C1 (en) * 2014-06-03 2015-09-27 Игорь Давидович Долгий Device to position railway rolling stock
GB2527330A (en) * 2014-06-18 2015-12-23 Gobotix Ltd Railway vehicle position and specific track location, provided by track and point detection combined with optical flow, using a near-infra-red video camera
EP3415400A1 (en) * 2017-06-12 2018-12-19 Siemens Aktiengesellschaft System and method for determining the position of a guided vehicle
US10176386B2 (en) 2014-12-29 2019-01-08 General Electric Company Method and system to determine vehicle speed
CN109334711A (en) * 2018-08-23 2019-02-15 浙江浙大列车智能化工程技术研究中心有限公司 A kind of train Precise Position System
CN109747681A (en) * 2019-01-14 2019-05-14 卡斯柯信号有限公司 A kind of train positioning device and method
US10311551B2 (en) 2016-12-13 2019-06-04 Westinghouse Air Brake Technologies Corporation Machine vision based track-occupancy and movement validation
GB2577106A (en) * 2018-09-14 2020-03-18 Reliable Data Systems International Ltd Vehicle Position Identification
EP3594624A3 (en) * 2018-07-10 2020-04-29 Robert Bosch GmbH Method for measuring distance, and system for measuring distance
EP3589528A4 (en) * 2017-02-28 2020-05-06 Thales Canada Inc. DEVICES, SYSTEMS, METHODS AND SOFTWARE FOR CONTROLLING AND TRACKING BY MEANS OF SEVERAL SENSORS, SSD / QR CHARACTERS AND / OR HF REFLECTORS
WO2020224862A1 (en) * 2019-05-03 2020-11-12 Siemens Mobility GmbH Method and computer program product for position determination of rail-bound vehicles and position determination system and rail-bound vehicle, in particular railway vehicle
CN112729378A (en) * 2020-12-04 2021-04-30 中国铁道科学研究院集团有限公司通信信号研究所 Hump speed and length measuring system and method based on image feature recognition
CN112866673A (en) * 2021-01-12 2021-05-28 北京格灵深瞳信息技术股份有限公司 Image acquisition equipment, camera control method and device and train image acquisition system
CN113390435A (en) * 2021-05-13 2021-09-14 中铁二院工程集团有限责任公司 High-speed railway multi-element auxiliary positioning system
EP4155163A1 (en) * 2021-09-23 2023-03-29 Cattron North America, Inc. Vision-based systems and methods for locomotive control and/or location determination
EP4212404A1 (en) 2022-01-17 2023-07-19 Urbanloop Method for determining the position and/or speed measurement of a vehicle
CN116620360A (en) * 2023-05-17 2023-08-22 中建三局信息科技有限公司 Rail car positioning system and method
US11866080B2 (en) 2019-10-17 2024-01-09 Thales Canada Inc Signal aspect enforcement
US11891098B1 (en) * 2023-03-22 2024-02-06 Dan Smythe Use of artificial intelligence to detect defects in trains and method to use
CN117693460A (en) * 2021-06-03 2024-03-12 奥斯提瑞恩有限责任公司 Method and device for detecting position and speed of railway vehicles
DE102023210683A1 (en) * 2023-10-27 2025-04-30 Siemens Mobility GmbH Position determination of a rail vehicle
EP4671084A1 (en) * 2024-06-28 2025-12-31 Siemens Mobility GmbH METHOD FOR DETERMINING THE SPEED OF A TRACK-GUIDED VEHICLE DRIVING ON A TRACK

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013218040A1 (en) * 2013-09-10 2015-03-12 Siemens Aktiengesellschaft Method and device for detecting a change in position of an at least partially disabled vehicle
DE102016223435A1 (en) * 2016-11-25 2018-05-30 Siemens Aktiengesellschaft Distance and speed measurement with the help of image recordings
DE102017212955A1 (en) * 2017-07-27 2019-01-31 Siemens Aktiengesellschaft Determining the speed of a rail vehicle using an on-board camera
DE102019206349A1 (en) * 2019-05-03 2020-11-05 Siemens Mobility GmbH Method and computer program product for recognizing signal signs for traffic control of lane-bound vehicles and signal sign recognition system and lane-bound vehicle, in particular rail vehicle
CN112455506B (en) * 2020-11-30 2022-06-24 株洲中车时代电气股份有限公司 Multi-dimensional self-calibration method and system for accurately positioning train running position
CN112526158A (en) * 2020-12-11 2021-03-19 济南和普威视光电技术有限公司 Laser speed measurement system and method based on optical equipment
CN112834777A (en) * 2020-12-31 2021-05-25 北京金日恒升科技有限公司 Train speed measuring method and tunnel media system installation position selecting method
DE102023202708A1 (en) 2023-03-24 2024-09-26 Zf Friedrichshafen Ag Device and method for determining a speed of a rail-bound vehicle
EP4671083A1 (en) * 2024-06-28 2025-12-31 Siemens Mobility GmbH METHOD FOR LOCATING A LANE-GUIDED VEHICLE
EP4696583A1 (en) * 2024-08-16 2026-02-18 Siemens Mobility GmbH Method for determining the speed of a track-guided vehicle travelling on a route

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2244581A (en) * 1990-06-02 1991-12-04 Solvit Scient Engineers Limite System to read barcode signs from or on a moving vehicle
DE19529986A1 (en) * 1995-08-04 1997-02-06 Siemens Ag Localisation method of rail-borne vehicles - involves registering total covered route from vehicle by means of radar or video recording
DE19627938A1 (en) * 1996-07-11 1998-01-15 Bosch Gmbh Robert Dynamic tracking method for vehicle guidance
DE19736774A1 (en) * 1997-08-23 1999-02-25 Bosch Gmbh Robert Information display method in vehicle
WO2002015144A2 (en) * 2000-08-12 2002-02-21 Facet Technology Corp. System for road sign sheeting classification
DE10063598A1 (en) * 2000-12-20 2002-06-27 Volkswagen Ag Traffic information monitoring method for providing traffic guidance information for vehicle drivers uses evaluation of data collected by cameras placed in circulating vehicles
WO2002058984A1 (en) * 2001-01-27 2002-08-01 Bombardier Transportation Gmbh Method and device for determining the current position of an object and for monitoring the planned path thereof
US20030030546A1 (en) * 2001-07-11 2003-02-13 Din-Chang Tseng Monocular computer vision aided road vehicle driving for safety
EP1383098A1 (en) * 2002-07-09 2004-01-21 Accenture Global Services GmbH System for automatic traffic sign recognition
US20040164851A1 (en) * 2003-02-24 2004-08-26 Crawshaw Richard D. Lane tracking system employing redundant image sensing devices

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2244581A (en) * 1990-06-02 1991-12-04 Solvit Scient Engineers Limite System to read barcode signs from or on a moving vehicle
DE19529986A1 (en) * 1995-08-04 1997-02-06 Siemens Ag Localisation method of rail-borne vehicles - involves registering total covered route from vehicle by means of radar or video recording
DE19627938A1 (en) * 1996-07-11 1998-01-15 Bosch Gmbh Robert Dynamic tracking method for vehicle guidance
DE19736774A1 (en) * 1997-08-23 1999-02-25 Bosch Gmbh Robert Information display method in vehicle
WO2002015144A2 (en) * 2000-08-12 2002-02-21 Facet Technology Corp. System for road sign sheeting classification
DE10063598A1 (en) * 2000-12-20 2002-06-27 Volkswagen Ag Traffic information monitoring method for providing traffic guidance information for vehicle drivers uses evaluation of data collected by cameras placed in circulating vehicles
WO2002058984A1 (en) * 2001-01-27 2002-08-01 Bombardier Transportation Gmbh Method and device for determining the current position of an object and for monitoring the planned path thereof
US20030030546A1 (en) * 2001-07-11 2003-02-13 Din-Chang Tseng Monocular computer vision aided road vehicle driving for safety
EP1383098A1 (en) * 2002-07-09 2004-01-21 Accenture Global Services GmbH System for automatic traffic sign recognition
US20040164851A1 (en) * 2003-02-24 2004-08-26 Crawshaw Richard D. Lane tracking system employing redundant image sensing devices

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2037224A1 (en) * 2007-09-12 2009-03-18 Pepperl + Fuchs Gmbh Method and device for determining the position of a vehicle, computer program and computer program product
RU2509021C2 (en) * 2008-06-13 2014-03-10 Сименс Акциенгезелльшафт Device and method for location signal generation
WO2009150086A1 (en) * 2008-06-13 2009-12-17 Siemens Aktiengesellschaft Device and method for generating a locating signal
US20110091077A1 (en) * 2008-06-13 2011-04-21 Siemens Aktiengesellschaft Device and method for production of a location signal
CN103733077A (en) * 2011-06-09 2014-04-16 Jmr公司 Device for measuring the speed and position of a vehicle moving along a guide track, and corresponding method and computer program product thereof
FR2976355A1 (en) * 2011-06-09 2012-12-14 Jean Luc Desbordes DEVICE FOR MEASURING SPEED AND POSITION OF A VEHICLE MOVING ALONG A GUIDE PATH, METHOD AND CORRESPONDING COMPUTER PROGRAM PRODUCT.
CN103733077B (en) * 2011-06-09 2015-04-29 Jmr公司 Device for measuring the speed and position of a vehicle moving along a guide track, and corresponding method and computer program product thereof
US9221481B2 (en) 2011-06-09 2015-12-29 J.M.R. Phi Device for measuring speed and position of a vehicle moving along a guidance track, method and computer program product corresponding thereto
EA024891B1 (en) * 2011-06-09 2016-10-31 Ж.М.Р. Пхи Device for measuring speed and position of a vehicle moving along a guidance track, method and computer program product corresponding thereto
WO2012168424A1 (en) * 2011-06-09 2012-12-13 POSIVIZ Jean-Luc DESBORDES Device for measuring speed and position of a vehicle moving along a guidance track, method and computer program product corresponding thereto
RU2518078C1 (en) * 2013-01-25 2014-06-10 Владимир Всеволодович Разевиг Optical method for railway train speed determination
RU2564295C1 (en) * 2014-06-03 2015-09-27 Игорь Давидович Долгий Device to position railway rolling stock
GB2527330A (en) * 2014-06-18 2015-12-23 Gobotix Ltd Railway vehicle position and specific track location, provided by track and point detection combined with optical flow, using a near-infra-red video camera
US10176386B2 (en) 2014-12-29 2019-01-08 General Electric Company Method and system to determine vehicle speed
US10311551B2 (en) 2016-12-13 2019-06-04 Westinghouse Air Brake Technologies Corporation Machine vision based track-occupancy and movement validation
EP3589528A4 (en) * 2017-02-28 2020-05-06 Thales Canada Inc. DEVICES, SYSTEMS, METHODS AND SOFTWARE FOR CONTROLLING AND TRACKING BY MEANS OF SEVERAL SENSORS, SSD / QR CHARACTERS AND / OR HF REFLECTORS
US11465660B2 (en) 2017-02-28 2022-10-11 Thales Canada Inc. Apparatuses, systems, methods, and software for train control and tracking using multi sensors, SSD/QR signs, and/or RF reflectors
EP3415400A1 (en) * 2017-06-12 2018-12-19 Siemens Aktiengesellschaft System and method for determining the position of a guided vehicle
EP3594624A3 (en) * 2018-07-10 2020-04-29 Robert Bosch GmbH Method for measuring distance, and system for measuring distance
CN109334711A (en) * 2018-08-23 2019-02-15 浙江浙大列车智能化工程技术研究中心有限公司 A kind of train Precise Position System
GB2577106A (en) * 2018-09-14 2020-03-18 Reliable Data Systems International Ltd Vehicle Position Identification
CN109747681A (en) * 2019-01-14 2019-05-14 卡斯柯信号有限公司 A kind of train positioning device and method
WO2020224862A1 (en) * 2019-05-03 2020-11-12 Siemens Mobility GmbH Method and computer program product for position determination of rail-bound vehicles and position determination system and rail-bound vehicle, in particular railway vehicle
US11866080B2 (en) 2019-10-17 2024-01-09 Thales Canada Inc Signal aspect enforcement
CN112729378B (en) * 2020-12-04 2022-11-18 中国铁道科学研究院集团有限公司通信信号研究所 System and method for hump speed measurement and length measurement based on image feature recognition
CN112729378A (en) * 2020-12-04 2021-04-30 中国铁道科学研究院集团有限公司通信信号研究所 Hump speed and length measuring system and method based on image feature recognition
CN112866673B (en) * 2021-01-12 2022-10-21 北京格灵深瞳信息技术股份有限公司 Image acquisition equipment, camera control method and device and train image acquisition system
CN112866673A (en) * 2021-01-12 2021-05-28 北京格灵深瞳信息技术股份有限公司 Image acquisition equipment, camera control method and device and train image acquisition system
CN113390435A (en) * 2021-05-13 2021-09-14 中铁二院工程集团有限责任公司 High-speed railway multi-element auxiliary positioning system
CN113390435B (en) * 2021-05-13 2022-08-26 中铁二院工程集团有限责任公司 High-speed railway multi-element auxiliary positioning system
EP4350453A4 (en) * 2021-06-03 2025-06-11 Ostirión, S.L.U. Method and equipment for detecting the location and speed of a railway vehicle
CN117693460A (en) * 2021-06-03 2024-03-12 奥斯提瑞恩有限责任公司 Method and device for detecting position and speed of railway vehicles
EP4155163A1 (en) * 2021-09-23 2023-03-29 Cattron North America, Inc. Vision-based systems and methods for locomotive control and/or location determination
US12371081B2 (en) 2021-09-23 2025-07-29 Cattron North America, Inc. Vision-based systems and methods for locomotive control and/or location determination
FR3131893A1 (en) 2022-01-17 2023-07-21 Urbanloop METHOD FOR LOCATING AND/OR SPEED MEASUREMENT OF A VEHICLE
EP4212404A1 (en) 2022-01-17 2023-07-19 Urbanloop Method for determining the position and/or speed measurement of a vehicle
US11891098B1 (en) * 2023-03-22 2024-02-06 Dan Smythe Use of artificial intelligence to detect defects in trains and method to use
CN116620360A (en) * 2023-05-17 2023-08-22 中建三局信息科技有限公司 Rail car positioning system and method
CN116620360B (en) * 2023-05-17 2024-04-23 中建三局信息科技有限公司 Rail car positioning system and method
DE102023210683A1 (en) * 2023-10-27 2025-04-30 Siemens Mobility GmbH Position determination of a rail vehicle
EP4671084A1 (en) * 2024-06-28 2025-12-31 Siemens Mobility GmbH METHOD FOR DETERMINING THE SPEED OF A TRACK-GUIDED VEHICLE DRIVING ON A TRACK

Also Published As

Publication number Publication date
EP1981748A1 (en) 2008-10-22
GB0602448D0 (en) 2006-03-22
EP1981748B1 (en) 2012-11-07

Similar Documents

Publication Publication Date Title
EP1981748B1 (en) System for measuring speed of a train
US11648968B2 (en) System and method for object and obstacle detection and classification in collision avoidance of railway applications
CN113536883B (en) Obstacle detection method, vehicle, apparatus, and computer storage medium
EP3820760B1 (en) Method and system for railway obstacle detection based on rail segmentation
US10297153B2 (en) Vehicle on-board controller centered train control system
CN107161141B (en) Unmanned automobile system and automobile
CA2273401C (en) Method and apparatus for using machine vision to detect relative locomotive position on parallel tracks
EP1157913B1 (en) Obstacle detection system
CA2998175C (en) System and method for multipurpose traffic detection and characterization
US20090037039A1 (en) Method for locomotive navigation and track identification using video
US20140218482A1 (en) Positive Train Control Using Autonomous Systems
Ruder et al. An obstacle detection system for automated trains
CN108639108B (en) A safety protection system for locomotive operation
Maire et al. Obstacle-free range determination for rail track maintenance vehicles
CN109664918A (en) Early warning protection system and method is tracked based on the train of truck traffic and initiative recognition
CN115158365B (en) Device and method for sensing traffic information in full time domain in complex space at side of platform door track area
CN116279663A (en) Vehicle-mounted intelligent anti-collision alarm control equipment
CN117253203A (en) Obstacle detecting system based on visual sensor
CN114877814A (en) Pantograph state detection device and method based on image processing
KR102004909B1 (en) Tongue rail inspection system for detecting the close contact
CN118753347B (en) Vehicle leading device, vehicle leading system and vehicle leading method based on machine vision and interlocking signal
CN116534085A (en) Railway shunting operation system and implementation method thereof
GB2527330A (en) Railway vehicle position and specific track location, provided by track and point detection combined with optical flow, using a near-infra-red video camera
CN119091575A (en) A train approach warning method, system and computer readable storage medium
CN115810283A (en) Roadside perception method and system in vehicle-road cooperation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2007705171

Country of ref document: EP