EP3654308B1 - Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem - Google Patents

Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem Download PDF

Info

Publication number
EP3654308B1
EP3654308B1 EP18206210.9A EP18206210A EP3654308B1 EP 3654308 B1 EP3654308 B1 EP 3654308B1 EP 18206210 A EP18206210 A EP 18206210A EP 3654308 B1 EP3654308 B1 EP 3654308B1
Authority
EP
European Patent Office
Prior art keywords
vehicle
light
light sources
light source
identification data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP18206210.9A
Other languages
English (en)
French (fr)
Other versions
EP3654308A1 (de
Inventor
Aleksandar Marjanovic
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aumovio Germany GmbH
Original Assignee
Continental Automotive Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive Technologies GmbH filed Critical Continental Automotive Technologies GmbH
Priority to EP18206210.9A priority Critical patent/EP3654308B1/de
Publication of EP3654308A1 publication Critical patent/EP3654308A1/de
Application granted granted Critical
Publication of EP3654308B1 publication Critical patent/EP3654308B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/22—Platooning, i.e. convoy of communicating vehicles

Definitions

  • the invention is concerned with a signaling device for signaling identification data of a first vehicle from that first vehicle to a following second vehicle.
  • a signaling device may be needed in connection with the so called platooning that is the first vehicle and the second vehicle are driving in a coordinated manner wherein driving maneuvers of the first vehicle are automatically taken over or copied by the second vehicle.
  • the invention also provides a platooning control system for coordinating the first vehicle and the second vehicle for driving these vehicles in a platoon.
  • a platooning control system with a signaling device is known from EP 0 762 364 B1 .
  • the signaling device is used for signaling identification data of a leading vehicle to a following second vehicle.
  • the same signaling device is used for transmitting maneuvering data or platooning data for the described coordination of maneuvers of two vehicles while driving in a platoon.
  • the signaling device comprises a light source that sends out the identification data as a serial stream of bits.
  • a special light receiver is needed in the receiving vehicle.
  • a video camera that is also used in the receiving vehicle for observing the leading vehicle cannot be used for receiving the fast changing light signal. This makes the known platooning control system technically complex.
  • US 2011/0169410 A1 describes a vehicle exterior lamp comprising an array of light emitting diodes (LEDs) with rows and columns and each LED positioned at an intersection thereof. An LED of the array is illuminated by selectively applying a signal to the row and column corresponding to the LED position.
  • LEDs light emitting diodes
  • the object is achieved by the subject matter of the independent claims. Additional embodiments that provide further advantages are described in the dependent claims, the following description and the drawings.
  • the invention provides a signaling device for signaling identification data of a first vehicle from that first vehicle to a second vehicle that follows or drives directly behind the first vehicle.
  • the signaling device comprises a light source arrangement for sending out light signals to the following vehicle, i.e. the second vehicle.
  • the device also comprises an electronic control unit for controlling the light source arrangement in accordance with the identification data by setting an activity state of the respective dedicated light source according to a corresponding content of the specific bit of the identification data.
  • the electronic control unit controls or switches the light source arrangement such that the light signals emitted by the light source arrangement carry the information describing the identification data.
  • the light sources of the light source arrangement that are dedicated to sending the bits of the identification data have a predefined opening angle of light radiation that is different from (i.e. smaller or larger than) the respective opening angle of at least one remaining light source of the light source arrangement.
  • the light sources used for sending out or signaling the bits of the identification data emit their light with a different opening angle than at least one remaining light source of the light source arrangement.
  • the difference regards the wideness or size of the opening angle, not a difference in orientation. From a predefined relative position, a traffic participants might either see only the light sources for sending the bits or the other way around only the lights of the at least one remaining light source. Thus, it can be prevented that traffic participants are irritated or disturbed by the signaling device.
  • the light source arrangement comprises an arrangement of several spatially distributed or spatially separated light sources.
  • at least two or three or four or more than four light sources are provided for transmitting the identification data.
  • These light sources are spatially distributed or separated, that is they can be seen as separate, independent light sources when seen from the point of view of the second vehicle.
  • the control unit is designed to signal predefined single bits of the identification data by means of a respective dedicated light source of the light source arrangement. In other words, for the first bit and the second bit and so on, i.e. for each bit, of the identification data, one specific light source is used for signaling the information (0 or 1) of that respective bit (bit set or bit not set).
  • the respective light source can be turned on or activated, if the respective corresponding bit is set to 1, and the light source can be turned off or deactivated, if the respective bit is set to 0.
  • 1 can also be signaled by a deactivated light source and accordingly 0 can be signaled by an activated light source.
  • the light sources are each dedicated to a specific bit, there is a predefined mapping for associating the each bit to a specific light source.
  • the invention comprises the advantage that the bits of the identification data are not sent out serially one after another which would demand a light receiver which could resolve the resulting fast changing light signal.
  • the invention provides several spatially distributed or separated light sources, each indicating the current state or information of a specific bit of the identification data.
  • a camera of the second vehicle that takes an image or several images of the leading first vehicle will see the identification data as brightness information and/or color information of specific pixels of the at least one image taken by the camera.
  • the identification data can be extracted from an image taken by a camera of the second vehicle. This requires less technical effort.
  • the light sources are arranged in a row.
  • the light sources form a line, which may be arranged, e.g., horizontally or vertically at the back of the first vehicle.
  • Arranging the light sources in a row provides the advantage that the position of the light sources may be interpolated or guessed in a camera image, even if a light source is deactivated or turned off.
  • the deactivated state of a light source may comprise that the light source is turned off, i.e. emits no light.
  • the deactivated state may comprise that the light source emits less light than in the activated state. This provides the advantage, that a deactivated light source may also be visible or detectable, e.g. in a camera image.
  • the invention also comprises embodiments that afford additional advantages.
  • the identification data comprises more bits than the light source arrangement comprises light sources that are dedicated for sending the bits.
  • the control unit is designed to group the bits of the identification data into frames or groups and to send each frame or group separately one after the other.
  • the light source arrangement might comprise four or eight lights dedicated for signaling the bits, wherein the number of bits contained in the identification data can be 8 or 16, respectively. This would require two frames for sending or signaling all the bits of the identification data. Using frames provides the advantage that the number of light sources provided in the light source arrangement is independent from the number of bits contained in the identification data.
  • control unit is designed to control one or more than one of the light sources as a respective frame control light.
  • the light source arrangement not only comprises light sources for signaling bits, but also at least one light source that is not used for signaling the bits, but rather for signaling when one frame ends and the next frame starts.
  • different light signal patterns activated or deactivated are signaled with each frame control light for identifying consecutive frames.
  • the control unit can be designed to send out the identification data repeatedly, in other words, once a sending cycle for sending out the identification data is finished, the sending cycle can start again or can be repeated.
  • control unit is designed to initiate or lead in the sending of the identification data by signaling an initial or starting frame with some or all of the light sources activated or turned on.
  • the starting frame does not signal the identification data themselves, but announces the sending of the identification data.
  • a following second vehicle may recognize the position of light source arrangements, for example on the basis of at least one camera image.
  • the starting frame optically indicates the position and/or geometry of the light sources that the control unit intends to use for signaling the bits of the identification data.
  • at least those light sources dedicated for signaling the bits of the identification data are turned on such that their position can be detected or determined for example in a camera image of a camera.
  • each of the mentioned frames lasts at least 100 milliseconds or at least 500 milliseconds.
  • each frame is visible throughout the duration of at least one video frame of a video camera.
  • Such a video frame normally lasts 20 milliseconds.
  • the respective activation state of each light source can be identified in a camera image, as no change of activation state of the light sources occurs during the recording of the image. No special light sensor additional to a camera is needed.
  • each frame is shorter than 10 seconds, preferably less than 5 seconds.
  • a succession of several frame leads to a blinking effect of the light source arrangement.
  • the light source arrangement can therefore be additionally used for signaling to other traffic participants that the first vehicle and the second vehicle are driving in a platooning mode.
  • a different brightness of the light sources for sending the bits might be provided when these light sources are in the activated state as compared to at least one remaining light source of the light source arrangement in the activated state.
  • the light sources used for signaling the information of the bits of the information data may have a different brightness in the activated state than the at least one remaining light source in the activated state. This can also be used for reducing the degree of irritation regarding other traffic participants and/or a driver of the following second vehicle. Likewise, different colors of light may be provided.
  • the light source arrangement is designed as two separate parts which are designed to be arranged on separate doors of a truck.
  • the light source arrangement can be placed on the doors at the back of a truck without hindering or blocking the doors.
  • the light source arrangement comprises less than 30 light sources. Additionally or alternatively, a distance of neighboring light sources is larger than 5 centimeters for all light sources. This makes sure that in a camera image of a camera of the second vehicle the light sources can be distinguished or separated on the basis of the image data of the camera, if the distance between the second vehicle and the first vehicle is smaller than a maximum distance value (e.g. 100 meters or 50 meters) which is typical for platooning.
  • a maximum distance value e.g. 100 meters or 50 meters
  • the light sources are designed to emit visible light, in particular yellow light.
  • the light source arrangement can also be used for signaling the platooning mode of the first and the second vehicle to other traffic participants.
  • the light sources do not emit visible light, but rather only infrared light.
  • the light signals of the light source arrangement will not irritate human drivers.
  • the light source arrangement comprises a mix of different light sources, with some light sources for emitting visible light (i.e. a color from red to blue) and some other light sources for emitting only invisible light, e.g. infrared light. This allows for controlling which light sources will also signal information to human drivers.
  • the signaling device may be used as part of platooning control system.
  • the invention also provides such a platooning control system comprising an embodiment of the inventive signaling device and a computer vision device.
  • the signaling device may be installed in a first, leading vehicle, wherein the computer vision device may be installed in a second vehicle following the first vehicle.
  • the computer vision device comprises a camera which is sensible to the light signals of the light sources of the signaling device.
  • the camera of the computer vision device is also designed to generate pixel-based images of the light sources.
  • the computer vision devices comprises an image processing unit which is designed to detect an activity state of each of the light sources in at least one image of the camera.
  • the image processing unit is also designed to reconstruct or recognize single bits of the identification data from the detected activity state of the light sources.
  • the computer vision device may determine from at least one camera image which light source of the signaling device is activated and which is deactivated, e.g. turned on or turned off.
  • the light sources are associated with a specific bit of the identification data, this allows for determining the content or information (0 or 1) of each of the bits of the identification data.
  • a conventional camera may be used for transmitting the identification data from a first vehicle to a second vehicle.
  • the platooning control system comprises a radio communication unit for receiving platooning data from another vehicle.
  • a radio communication unit may be based on the so called vehicle-to-vehicle communication technology.
  • the radio communication unit may be based on WIFI-technology and/or Bluetooth technology and/or mobile communication technology (e.g. 5G).
  • the platooning data may be transmitted.
  • Such platooning data may comprise data regarding a maneuver planned or initiated by a leading vehicle of a platoon and/or by the first vehicle.
  • the platooning data especially also comprises identification data of the vehicle that is sending out the platooning data and/or that is leading the platoon.
  • a following second vehicle may receive the platooning data by means of the radio communication unit and therefore may therefore know or determine the next maneuver of the leading vehicle.
  • the second, following vehicle cannot be sure simply from the platooning data themselves, whether the vehicle that is actually or physically driving in front of the second vehicle is that leading vehicle that also sent out the platooning data. Therefore, the platooning control system is designed to associate the platooning data to a vehicle carrying the described signaling device. This is done on the basis of the identification data detected in the at least one image of the camera of the computer vision device on one side and on the basis of the identification data contained in the platooning data on the other side.
  • the platooning data received over the radio communication unit belong to the vehicle that is visible in the camera image.
  • the use of radio communication provides the advantage that the actual platooning data can be transferred at a higher data rate than is possible by means of light signals. Additionally or alternatively, the transfer of the platooning data is more robust and/or weather conditions may influence the radio communication less than the transfer of light signals.
  • the operation of the platooning control system results in a method which is also part of the invention.
  • the inventive method is for signaling identification data of a first vehicle from that first vehicle to a following second vehicle.
  • a signaling device provides a light source arrangement for sending out a light signal to the following second vehicle and an electronic control unit controls the light source arrangement in accordance with the identification data.
  • the light source arrangement provides a spatially distributed arrangement of several light sources and the control unit signals predefined single bits of the identification data by means of a respective dedicated light source of the light source arrangement by setting an activity state of the respective dedicated light source according to a corresponding content of the specific bit of the identification data.
  • the light sources of the light source arrangement that are dedicated to sending the bits of the identification data have a predefined opening angle of light radiation that is different from (i.e. smaller or larger than) the respective opening angle of at least one remaining light source of the light source arrangement.
  • the light sources used for sending out or signaling the bits of the identification data emit their light with a different opening angle than at least one remaining light source of the light source arrangement.
  • the difference regards the wideness or size of the opening angle, not a difference in orientation. From a predefined relative position, a traffic participants might either see only the light sources for sending the bits or the other way around only the lights of the at least one remaining light source. Thus, it can be prevented that traffic participants are irritated or disturbed by the signaling device.
  • a computer vision device operates a camera which is sensible to light signals of the light sources of the signaling device and which is designed to generate pixel-based images of the light sources.
  • An image processing unit of the computer vision device detects the respective activity state of each of the light sources in at least one image of the camera and reconstructs single bits of the identification data from the detective activity states of the light sources.
  • each frame of signal bits may last longer or may have a duration which is larger than the capturing time for a single camera image (which is usually 1/50 or 1/60 of a second).
  • each frame of bits of the identification data may be visible in several successive camera images.
  • the image processing unit detects the respective activity state of each of the light sources in several images that show a specific frame of bits. Then, the final reconstruction of the single bits of the identification data is done as a mean value and/or count value (i.e. a statistical evaluation) of the detective activity states as detected in the several images.
  • a mean value and/or count value i.e. a statistical evaluation
  • the computer vision device may group or identify images showing the same frame on the basis of the described light signal patterns emitted by the additional control lights. Such a light signal pattern may switch or change whenever the control unit switches from one frame to a successive frame. Thus, by the currently emitted signal pattern of the control lights it is visible whether still the same frame or the next frame is signaled.
  • the platooning control system may be installed in vehicles that may be designed for driving in a platoon, for example in trucks.
  • the invention also comprises the combinations of the features of the described embodiments.
  • Fig. 1 shows a top view of a driving scene 10 where two vehicles 11, 12 are driving as a platoon 13.
  • the vehicles 11, 12 can be, for example, trucks.
  • the vehicles 11, 12 may be driving on a track 14 of a road 15.
  • a second track 16 is shown which may be used by a further vehicle 17, for example a passenger vehicle that is overtaking the platoon 13.
  • vehicle 11 may be a leading or first vehicle V1 of the platoon 13.
  • the first vehicle 11 need not be the front vehicle or very first vehicle of the platoon 13.
  • the first vehicle 11 may be following another vehicle of the platoon 13 or it may be the front vehicle.
  • Vehicle 12 may be a following or second vehicle V2 driving directly behind vehicle V1 in the order of the platoon 13.
  • the second vehicle V2 may be driven or steered or conducted by an electronic control unit 18 such that the driver of the second vehicle may relax or concentrate on another activity than driving vehicle 12.
  • electronic control unit 18 may control a driving speed 19 and/or a steering 20 of vehicle 12 in dependence on the driving speed 21 and/or the steering 22 of vehicle 11.
  • an electronic control unit 23 of vehicle 11 may signal platooning data 24 indicating the driving speed 21 and/or the steering 22 of vehicle 11 and/or a maneuver planned or executed by vehicle 11.
  • the platooning data 24 may be signaled by means of radio communication unit 25 that may communicate with a corresponding radio communication unit 26 of vehicle 12 over a radio communication link 27, e.g.
  • Control unit 18 may receive the platooning data 24 over the communication unit 26 and may then set the driving speed 19 and/or the steering 20 for vehicle 12. In this way, vehicle 12 may follow vehicle 11 autonomously or by means of an autonomous driving function of control unit 18 without a driver of vehicle 12 necessarily steering vehicle 12.
  • the first vehicle or leading vehicle 11 may identify itself on the basis of identification data 28 which may be contained in the platooning data 24. Additionally, vehicle 11 may signal the identification data 28 as light signals 29 which may be emitted by a light source arrangement R of a signaling device 30. Light source arrangement R may be attached to a back side 31 of vehicle 11.
  • vehicle 12 directly following vehicle 11 is able to capture image data 32 of the light source arrangement R by means of a video or still image camera 33.
  • Camera 33 may be part of a computer vision device 34 that may also comprise an image processing module or image processing unit 35 that may be provided as a software module for, e.g., electronic control unit 18 or another electronic control unit (not shown).
  • image processing unit 35 may recognize the identification data 28 in the light signals 29 on the basis of the image data 32.
  • the vehicle 12 may verify that the platooning data 24 received over the radio communication link 27 originate from the directly leading vehicle 11. Therefore, an electronic control unit 18 may decide that it is safe to set the vehicles speed 19 and/or the steering 20 for vehicle 12 according to the platooning data 24, as they match the directly leading vehicle 11 such that the platoon 13 is driving correctly.
  • vehicle 12 may also send its own platooning data to a following vehicle (not shown) and by means of an additional light source arrangement R', the same verification may be provided for the next vehicle.
  • the signaling device 30 and the computer vision device 34 together form a platooning control system 36.
  • a driver of vehicle 17 may also see the signaling device 30.
  • the light signals 29 may be generated by blinking light sources (not shown in Fig. 1 )
  • the signaling device 30 may also function as a visual indicator to the driver of vehicle 17 that the two vehicles 11, 12 are driving in a platoon 13 such that the driver may avoid steering the vehicle 17 between the two vehicles 11, 12.
  • a field of view FOV of camera 33 is indicated in Fig. 1 by dashed lines.
  • the back side 31 of leading vehicle 11 may be positioned inside the field of view FOV.
  • Fig. 2 illustrates a view onto the back side 31 of the first vehicle 11 as it might be seen from vehicle 12.
  • the view shown in Fig. 2 can be an image as represented by the image data 32 captured by camera 33 of the computer vision device 34.
  • the signaling device 30 can be arranged in a bottom position at the back side 31 as shown in Fig. 2 .
  • the signaling device can be positioned at alternative positions 37, 38 higher than the position shown.
  • the signaling device 30 can be provided as one single part as shown in Fig. 2 or in several different parts 39, for example two parts, for arranging the signaling device at doors 40 at the back side 31 of vehicle 11.
  • the light source arrangement R of signaling device 30 may comprise several light sources 41 which may be arranged in a row, for example a horizontal row as shown in Fig. 2 or a vertical row (not shown). For the sake of clarity, only two light sources are provided with the corresponding reference sign for light sources 41.
  • the light sources 41 may be controlled by the control unit 23 of vehicle 11 or by another control unit (not shown). By means of the light sources 41 not all of the platooning data 24 need to be signaled. It may be sufficient to signal only the identification data 28.
  • the identification data 28 may be sent repeatedly in signaling cycles.
  • Fig. 3 illustrates, how the light sources 41 of signaling device 30 may be switched between a deactivated state and an activated state for signaling the identification data 28.
  • two possible activation states or activity states are illustrated, that is a deactivated state 42 and an activated state 43.
  • the activity states are shown over the time t wherein for different time frames TF the activation state of each light source 41 is set individually.
  • Each time frame TF may comprise an on-time or a lighting time TL and an off-time or a pause time TP. After each pause time TP, the next time frame TF starts with the lighting time TL. During the pause time TP, all light sources 41 may be in the deactivated state.
  • the activity state is set according to the specific meaning of the current time frame TF.
  • a signaling cycle 44 may start with a starting frame SF followed by four time frames signaling single bytes B0, B1, B2 of the identification data 28.
  • the illustrated examples shows identification data 28 comprising 3 bytes. More or less bytes or another number of bits is possible.
  • Fig. 3 also illustrates, how the identification data 28 may signal an identification ID of vehicle 11 which may comprise the three bytes B0, B1, B2 wherein each byte B0, B1, B2 may comprise eight bits b with numbers 0 to 7 wherein the bits 0, 1, 2, 3 may constitute the least significant bits LSB and the bit 4, 5, 6, 7 may constitute the most significant bits MSB.
  • an identification ID of vehicle 11 which may comprise the three bytes B0, B1, B2 wherein each byte B0, B1, B2 may comprise eight bits b with numbers 0 to 7 wherein the bits 0, 1, 2, 3 may constitute the least significant bits LSB and the bit 4, 5, 6, 7 may constitute the most significant bits MSB.
  • bits 0, 1, 2 of byte B0 are indicated with a reference sign.
  • the activity state of specific dedicated light sources 45 is set according to the corresponding content (0 or 1) of a specific bit of the identification data 28 as indicated in Fig. 3 , wherein the association between light source 45 and the corresponding bit b is only exemplary.
  • the cross hatch indicates that the activation state of the light source 45 in the specific time frame TF depends on the content of the associated bit b, i.e. whether the bit b is 0 or 1.
  • Other light sources 41 may function as frame control lights 46 which change their activity state with the successive time frames TF such that with the change of time frames TF, a blinking effect is generated.
  • the control lights 46 together form a light pattern for visually ideating when one frame ends and the next starts.
  • the start frame SF may be an initial frame which optically indicates a respective position and/or geometry of the light sources 41, especially the dedicated light sources 45. To this end, all or most of the light sources may be in the activated state during the start frame SF. Some of the light sources 41 may be used as bound light sources 47 indicating the bounds or boundaries of the row of light source arrangement R. This may support the computer vision device 34 in recognizing the light source arrangement R in successive images generated or captured by camera 33.
  • Fig. 4 illustrates, how the different light sources 41 of signaling device 30 may provide different angles 48, 49.
  • Some of the light sources 41 may provide an angle 48 that is narrower than the angle 49 of at least one other light source 41.
  • the wider angle 49 may be designed to present parts or some of the light signals 29 not only to camera 33, but also to a vehicle 17 passing by the platoon 13.
  • the control lights 46 which provide a blinking effect, may have an angle 49 such that the blinking effect is also visible from the passing by vehicle 17.
  • the narrower angle 48 maybe adjusted in such a way that the camera 33 may receive the light signals 29 of the corresponding light sources 41 without at the same time being perceivable by a driver of a passing by vehicle 17.
  • the height and/or orientation of the corresponding light sources 41 may be adjusted to the height of camera 33 of the same platooning control system 36.
  • the light sources 41 may comprise the same or different light color and/or type of radiation (visible light, infrared, ultraviolet). They may be of the same color or of different colors.
  • the leading vehicle Instead of identifying the leading or previous vehicle in a platoon 13 by reading its registration plate or a QR-Code on the vehicle's backside by a camera's image recognition, the leading vehicle actively emits light signals 29 by means of light sources 41 of a signaling device 30. This reduces the difficulty in detecting the signaling device as opposed to the detection of as small registration plate and its content on the backside of a truck due to the limited resolution of a camera as it may be provided in the second vehicle 12. Additionally, at low illuminance condition, it is not possible to get an image of adequate quality for recognizing a registration plate or a QR-Code.
  • the platooning control system 36 provides the possibility of identifying the leading or previous vehicle in a platoon 13 from a following vehicle 12 by means of a forward-looking camera 33 for ensuring that the identification data as received via vehicle-to-vehicle-communication as part of platooning data 24 belong to the vehicle 11 immediately in front of the vehicle 12.
  • a light source arrangement R of light sources for example LED lights (LED-light emitting diode), which emit blinking signal frames TF in a time sequence over time t that can be recognized or captured by following vehicles forward-looking camera 33 and can be analyzed by an image processing unit 35.
  • LED lights LED-light emitting diode
  • the identification data 28 may be provided in a control unit for performing the control of the platoon 13 and may be transferred to a control unit 23 for controlling the light source.
  • the light sources 41 of the light source arrangement R may constitute a visual warning to other vehicles 17 as they generate blinking light signals 29 indicating that the vehicles 11, 12 of platoon 13 currently in a platooning formation, i.e. the distance between the two vehicles 11, 12 of platoon 13 (and further following vehicles) may be smaller than allowed for the case that the following vehicle is driven by a driver (manual driving). For both usage, yellow may be an appropriate color of the light sources 41.
  • the identification sequence resulting from the identification data 28 may consist of a starting frame SF (for example all light sources 41 turned on or activated except for example the most left and right light source 47-bounding light sources 47).
  • Successive time frames TF may signal single bytes B0, B1, B2 with the bound light sources 47 activated, wherein controlling lights 46 may alternate their activity state from on to off with each time frame TF.
  • Eight dedicated light sources 45 may be data light sources indicating the single bits B of the byte B0, B1, B2 that is to be transmitted. This example is valid for the case that eight dedicated light sources 45 as data light sources are available.
  • bounding light sources 47 can be the denoting of the total width of the light source arrangement R, while the controlling lights 46 (for example two of them just next to the bounding light sources 47 and one in the middle of the light source arrangement R) with their alternate turning on and off designating the time periods or frame periods of the single time frames TF.
  • the implementation of the light sources 41 is better visible even in night conditions compared to registration plates and/or printed QR-Codes, especially at distances larger 30 meters or 50 meters.
  • the distance between single neighboring light sources 41 can be adapted to the camera resolution of the camera 33 belonging to the cartooning control system 36 such that two different light sources 41 in neighboring positions may still be resolved at a predefined given distance between the vehicles 11, 12.
  • the person skilled in the art may experiment with different light sources and light source arrangements and activation of single light sources during a time frame TF and with duration of the time frames TF. Additionally or alternatively, the light source arrangement R can be split up or separated into two halves or parts 39 (one per back door side of the back doors 40) and be mounted at a higher position (see Fig. 2 ) at the truck's rear side or back side 31.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Claims (15)

  1. Signalisierungsvorrichtung (30) zum Signalisieren von Identifikationsdaten (28) eines ersten Fahrzeugs (11) von diesem ersten Fahrzeug (11) an ein nachfolgendes zweites Fahrzeug (12), wobei die Vorrichtung (30) eine Lichtquellenanordnung (R) zum Aussenden von Lichtsignalen (29) von dem ersten Fahrzeug (11) an das nachfolgende zweite Fahrzeug (12) und eine elektronische Steuereinheit (23) zum Steuern der Lichtquellenanordnung (R) gemäß den Identifikationsdaten (28) aufweist, wobei die Lichtquellenanordnung (R) eine Anordnung von einigen räumlich verteilten Lichtquellen (41) aufweist und die Steuereinheit (23) ausgelegt ist zum Signalisieren vordefinierter Einzelbits (b) der Identifikationsdaten (28) mittels einer jeweiligen dedizierten Lichtquelle (41, 45) der Lichtquellenanordnung (R) durch Einstellen eines Aktivitätszustands (42, 43) der jeweiligen dedizierten Lichtquelle (41, 45) gemäß einem entsprechenden Inhalt des spezifischen Bits (b) der Identifikationsdaten (28),
    dadurch gekennzeichnet, dass die dedizierten Lichtquellen (41, 45) zum Senden der Bits (b) einen vordefinierten Öffnungswinkel (48) von Lichtstrahlung aufweisen, der sich von dem entsprechenden Öffnungswinkel (49) mindestens einer übrigen Lichtquelle (41) der Lichtquellenanordnung (R) unterscheidet.
  2. Signalisierungsvorrichtung (30) nach Anspruch 1, wobei die Identifikationsdaten (28) mehr Bits (b) aufweisen als die Lichtquellenanordnung (R) dedizierte Lichtquellen (41, 45), die zum Signalisieren der Bits (b) dediziert sind, aufweist, und wobei die Steuereinheit (23) ausgelegt ist zum Gruppieren der Bits (b) der Identifikationsdaten (28) in Frames (TF) und zum getrennten Senden jedes Frames (TF) einen nach dem anderen.
  3. Signalisierungsvorrichtung (30) nach Anspruch 2, wobei die Steuereinheit (23) ausgelegt ist zum Steuern einer oder mehr als einer der Lichtquellen (41) als ein jeweiliges Framesteuerlicht (46) durch Signalisieren alternierender Lichtsignalmuster mit jedem Framesteuerlicht (46) zum Identifizieren aufeinanderfolgender Frames (TF).
  4. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die Steuereinheit (23) ausgelegt ist zum Initiieren des Sendens der Identifikationsdaten (28) durch Signalisierung eines Startframes (SF) mit manchen oder allen der Lichtquellen (41) aktiviert, wobei der Startframe (SF) optisch eine Position und/oder eine Geometrie der Lichtquellen (41) angibt, die die Steuereinheit (23) für Signalisierung der Bits (b) der Identifikationsdaten (28) zu verwenden beabsichtigt.
  5. Signalisierungsvorrichtung (30) nach einem der Ansprüche 2 bis 4, wobei jeder Frame (TF) mindestens 100 Millisekunden oder mindestens 500 Millisekunden andauert.
  6. Signalisierungsvorrichtung (30) nach einem der Ansprüche 2 bis 5, wobei jeder Frame (TF) weniger als 10 Sekunden oder weniger als 5 Sekunden andauert.
  7. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die dedizierten Lichtquellen (41, 45) zum Senden der Bits (b) im aktivierten Zustand (43), im Vergleich mit mindestens einer übrigen Lichtquelle (41) der Lichtquellenanordnung (R) im aktivierten Zustand (43), eine andere Helligkeit aufweisen.
  8. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die Lichtquellenanordnung (R) als zwei getrennte Teile (39) ausgelegt ist, die dafür ausgelegt sind, an getrennten Türen (40) eines Lastwagens angeordnet zu sein.
  9. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die Lichtquellenanordnung (R) weniger als 30 Lichtquellen (41) aufweist und/oder ein Abstand von benachbarten Lichtquellen (41) größer als 5 cm ist.
  10. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die Lichtquellen (41) ausgelegt sind zum Emittieren von sichtbarem Licht, insbesondere gelbem Licht, oder nur von Infrarotlicht oder die Lichtquellenanordnung (R) eine Mischung von verschiedenen Lichtquellen (41) aufweist, mit manchen Lichtquellen (41) zum Emittieren sichtbaren Lichts und manchen anderen Lichtquellen (41) zum Emittieren von nur unsichtbarem Licht.
  11. Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche, wobei die Lichtquellen (41) in einer Reihe angeordnet sind.
  12. Kolonnenfahrtsteuerungssystem (36), aufweisend eine Signalisierungsvorrichtung (30) nach einem der vorhergehenden Ansprüche und eine Computervisionsvorrichtung (34), wobei die Computervisionsvorrichtung (34) eine Kamera (33) aufweist, die auf Lichtsignale (29) der Lichtquellen (41) der Signalisierungsvorrichtung (30) empfindlich ist und die ausgelegt ist zum Erzeugen pixelbasierter Bilder (32) der Lichtquellen (41), und wobei die Computervisionsvorrichtung (34) eine Bildverarbeitungseinheit (35) aufweist, die ausgelegt ist zum Detektieren eines Aktivitätszustands (42, 43) von jeder der Lichtquellen (41) in mindestens einem der Bilder (32) der Kamera (33) und zum Rekonstruieren von Einzelbits (b) von Identifikationsdaten (28) aus den detektierten Aktivitätszuständen (42, 43) der Lichtquellen (41).
  13. Kolonnenfahrtsteuerungssystem (36) nach Anspruch 12, wobei das Kolonnenfahrtsteuerungssystem (36) eine Funkkommunikationseinheit (26) zum Empfangen von Kolonnenfahrtdaten (24) von einem anderen Fahrzeug (11) aufweist, wobei die Kolonnenfahrtdaten (24) auch die Identifikationsdaten (28) aufweisen, und das Kolonnenfahrtsteuerungssystem (36) ausgelegt ist zum Verknüpfen der Kolonnenfahrtdaten (24) mit einem Fahrzeug (11), das die Signalisierungsvorrichtung (30) mit sich führt, auf der Grundlage der Identifikationsdaten (28), die in dem mindestens einen Bild (32) detektiert wurden, und auf der Grundlage der Identifikationsdaten (28), die in den Kolonnenfahrtdaten (24) enthalten sind.
  14. Verfahren zum Signalisieren von Identifikationsdaten (28) eines ersten Fahrzeugs (11) von diesem ersten Fahrzeug (11) an ein nachfolgendes zweites Fahrzeug (12), wobei in dem ersten Fahrzeug (11) eine Signalisierungsvorrichtung (30) eine Lichtquellenanordnung (R) zum Aussenden von Lichtsignalen (29) an das nachfolgende zweite Fahrzeug (12) bereitstellt und eine elektronische Steuereinheit (23) die Lichtquellenanordnung (R) gemäß den Identifikationsdaten (28) steuert, wobei die Lichtquellenanordnung (R) eine räumlich verteilte Anordnung von einigen Lichtquellen (41) bereitstellt und die Steuereinheit (23) vordefinierte Einzelbits (b) der Identifikationsdaten (28) mittels einer jeweiligen dedizierten Lichtquelle (41, 45) der Lichtquellenanordnung (R) durch Einstellen eines Aktivitätszustands (42, 43) der jeweiligen dedizierten Lichtquelle (41, 45) gemäß einem entsprechenden Inhalt des spezifischen Bits (b) der Identifikationsdaten (28) signalisiert, dadurch gekennzeichnet, dass die dedizierten Lichtquellen (41, 45) zum Senden der Bits (b) einen vordefinierten Öffnungswinkel (48) von Lichtstrahlung aufweisen, der sich von dem entsprechenden Öffnungswinkel (49) mindestens einer übrigen Lichtquelle (41) der Lichtquellenanordnung (R) unterscheidet, und dass in dem zweiten Fahrzeug (12) eine Computervisionsvorrichtung (34) eine Kamera (33) betreibt, die auf Lichtsignale (29) der Lichtquellen (41) der Signalisierungsvorrichtung (30) empfindlich ist und die ausgelegt ist zum Erzeugen pixelbasierter Bilder (32) der Lichtquellen (41), wobei eine Bildverarbeitungseinheit (35) der Computervisionsvorrichtung (34) den jeweiligen Aktivitätszustand (42, 43) von jeder der Lichtquellen (41) in mindestens einem Bild (32) der Kamera (33) detektiert und die Einzelbits (b) der Identifikationsdaten (28) aus den Aktivitätszuständen (42, 43) der Lichtquellen (41), wie in den Bildern (32) detektiert, rekonstruiert.
  15. Verfahren nach Anspruch 14, wobei die Bildverarbeitungseinheit (34) den jeweiligen Aktivitätszustand (42, 43) von jeder der Lichtquellen (41) in einigen Bildern (32), die einen spezifischen Frame (TF) von Bits (b) zeigen, detektiert und die Einzelbits (b) der Identifikationsdaten (28) als einen Mittelwert der jeweiligen Aktivitätszustände (42, 43) der jeweiligen dedizierten Lichtquellen (41, 45), wie in den einigen Bildern (32) detektiert, rekonstruiert.
EP18206210.9A 2018-11-14 2018-11-14 Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem Active EP3654308B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18206210.9A EP3654308B1 (de) 2018-11-14 2018-11-14 Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP18206210.9A EP3654308B1 (de) 2018-11-14 2018-11-14 Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem

Publications (2)

Publication Number Publication Date
EP3654308A1 EP3654308A1 (de) 2020-05-20
EP3654308B1 true EP3654308B1 (de) 2021-05-19

Family

ID=64316371

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18206210.9A Active EP3654308B1 (de) 2018-11-14 2018-11-14 Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem

Country Status (1)

Country Link
EP (1) EP3654308B1 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116009575A (zh) * 2022-10-27 2023-04-25 令箭科技(广州)有限责任公司 基于视觉的无人机控制方法、无人机及无人机编队

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3358403B2 (ja) 1995-09-11 2002-12-16 トヨタ自動車株式会社 隊列走行制御装置
US8314558B2 (en) * 2010-01-12 2012-11-20 Ford Global Technologies, Llc Light emitting diode headlamp for a vehicle

Also Published As

Publication number Publication date
EP3654308A1 (de) 2020-05-20

Similar Documents

Publication Publication Date Title
US11627389B2 (en) Vehicular vision system with infrared emitter synchronization
US11745755B2 (en) Vehicular driving assist system with driver monitoring
US7961086B2 (en) System and method for vehicular communications
US20080122607A1 (en) System and Method for Vehicular Communications
US10929693B2 (en) Vehicular vision system with auxiliary light source
US20080122606A1 (en) System and Method for Vehicular Communications
US20070242339A1 (en) System and Method for Vehicular Communications
EP2448251B1 (de) Gebündelte Nachtsicht- und andere Fahrerhilfssysteme unter Verwendung von Nah-Infrarot-Beleuchtung und einer Rollblende.
US20070242338A1 (en) System and Method for Vehicular Communications
WO2007126874A2 (en) Video traffic monitoring and signaling apparatus
US10165653B2 (en) Vehicle rear lamp
CN108657069A (zh) 用于照明诊断的车辆成像系统和方法
JP6062214B2 (ja) 路車間通信システムおよび送受信装置
CA2885777C (en) Control of flicker in display images using light emitting element arrays as viewed by a viewer in motion
EP3654308B1 (de) Signalisierungsvorrichtung und verfahren zum signalisieren von identifikationsdaten von einem ersten fahrzeug an ein nachfolgendes zweites fahrzeug und entsprechendes fahrzeugkolonnensteuerungssystem
CN112996694B (zh) 用于机动车辆的车道识别
DE102004020682A1 (de) Bildaufnahmesystem
GB2309112A (en) Visual information systems
GB2380883A (en) Location and identification of participants in a sporting event by means of optically readable tags
US10217006B2 (en) Method and device for detecting objects in the dark using a vehicle camera and a vehicle lighting system
JP2617845B2 (ja) 発光表示装置
JP2025141712A (ja) 可視光通信システム
JP7844065B1 (ja) 信号機
JP2025013066A (ja) 信号システム及び信号灯器
KR20250150805A (ko) 차량 모듈형 블록 램프 및 이를 이용한 제어 방법

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201120

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210127

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018017225

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1394733

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1394733

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210519

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210819

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210820

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210919

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210920

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210819

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018017225

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20220222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210919

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018017225

Country of ref document: DE

Owner name: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, DE

Free format text: FORMER OWNER: CONTINENTAL AUTOMOTIVE GMBH, 30165 HANNOVER, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018017225

Country of ref document: DE

Owner name: AUMOVIO GERMANY GMBH, DE

Free format text: FORMER OWNER: CONTINENTAL AUTOMOTIVE GMBH, 30165 HANNOVER, DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211114

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211130

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20211130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211130

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20211130

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230522

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20181114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221114

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018017225

Country of ref document: DE

Owner name: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, DE

Free format text: FORMER OWNER: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, 30165 HANNOVER, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018017225

Country of ref document: DE

Owner name: AUMOVIO GERMANY GMBH, DE

Free format text: FORMER OWNER: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, 30165 HANNOVER, DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210519

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20251130

Year of fee payment: 8

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018017225

Country of ref document: DE

Owner name: AUMOVIO GERMANY GMBH, DE

Free format text: FORMER OWNER: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH, 30175 HANNOVER, DE