EP2990251A2 - Dispositif et procede d'utilisation de contenus multimedia dans un moyen de transport - Google Patents

Dispositif et procede d'utilisation de contenus multimedia dans un moyen de transport Download PDF

Info

Publication number
EP2990251A2
EP2990251A2 EP15181245.0A EP15181245A EP2990251A2 EP 2990251 A2 EP2990251 A2 EP 2990251A2 EP 15181245 A EP15181245 A EP 15181245A EP 2990251 A2 EP2990251 A2 EP 2990251A2
Authority
EP
European Patent Office
Prior art keywords
file
display element
locomotion
display
headliner
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15181245.0A
Other languages
German (de)
English (en)
Other versions
EP2990251B1 (fr
EP2990251A3 (fr
Inventor
Jonas Gottlieb Skytte
Christiane Wölfel
Morten Dahl Amby
Tom Quast
Tor Sørensen
Lasse Iversen
David Møller Andersen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Volkswagen AG
Original Assignee
Volkswagen AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volkswagen AG filed Critical Volkswagen AG
Publication of EP2990251A2 publication Critical patent/EP2990251A2/fr
Publication of EP2990251A3 publication Critical patent/EP2990251A3/fr
Application granted granted Critical
Publication of EP2990251B1 publication Critical patent/EP2990251B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/85—Arrangements for transferring vehicle- or driver-related data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
    • H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
    • H04M1/6041—Portable telephones adapted for handsfree use
    • H04M1/6075—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle
    • H04M1/6083—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system
    • H04M1/6091—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system including a wireless interface
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/11—Instrument graphical user interfaces or menu aspects
    • B60K2360/113—Scrolling through menu items
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/11—Instrument graphical user interfaces or menu aspects
    • B60K2360/115—Selection of menu items
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B60K2360/1464—3D-gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/164—Infotainment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/334—Projection means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55—Remote control arrangements
    • B60K2360/56—Remote control arrangements using mobile devices
    • B60K2360/563—Vehicle displaying mobile device information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55—Remote control arrangements
    • B60K2360/56—Remote control arrangements using mobile devices
    • B60K2360/569—Vehicle controlling mobile device functions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/589—Wireless data transfers
    • B60K2360/5899—Internet
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/592—Data transfer involving external databases
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/771—Instrument locations other than the dashboard on the ceiling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/02—Details of telephonic subscriber devices including a Bluetooth® interface

Definitions

  • the present invention relates to a device for operating multimedia content in a means of transportation and a corresponding method.
  • the present invention includes incorporating different users into a selection process, as well as other interactions related to multimedia content provided in a vehicle.
  • Modern vehicles may display different multimedia content for selection by a user on a screen.
  • the buttons representing the files, labels or the like can be displayed, reversed in their order or deleted from a displayed list.
  • audio or video playback is started.
  • route planning and definition of a route destination (optionally including intermediate destinations)
  • similar operating steps and address lists are known.
  • address entries can be selected and adopted as the destination.
  • EP 1 798 588 A1 discloses an operating system for operating functions in a vehicle, which comprises a projection device for projecting fictitious operating elements onto an associated projection surface in the vehicle.
  • a projection device for projecting fictitious operating elements onto an associated projection surface in the vehicle.
  • WO 2006/130543 A2 discloses a roof system for a means of transportation with a transparent display panel.
  • the display panel can be used to display images.
  • a user interface is also provided on the display panel and has instruments, displays and touch-operated switches. The display of music lists is also proposed.
  • the known systems do not support interactive operations between the occupants of the vehicle. If the inmates want to jointly define a playlist or set of targets for a navigation system, they rely on verbal communication. It is therefore an object of the present invention to support an occupant interaction of a vehicle during the planning and modification of future shared experiences and sensory impressions.
  • the above object is achieved by a method with the features of claim 1 and by a device having the features of claim 11. Furthermore, a means of transport with the features according to claim 14, a computer program product with the features according to claim 15 and a signal sequence with the features according to claim 16 are proposed.
  • the method is used to operate multimedia content in a means of transportation and is suitable for collaborative viewing and sorting of electronic files with respect to a common future (sensory) experience.
  • a first display element representing a first file on the headliner of a means of transport is displayed. This can be done in particular by projecting the first display element to the headliner. Alternatively, matrix displays provided on the headliner are also usable.
  • the display elements in the context of the present invention form general spoken disjoint from each other over the headliner movable elements.
  • a user input regarding the first display element is received. This may be, for example, a touch of the headliner in the region of the display element, which is sensed.
  • a projection for example, an optical recognition of the position of the finger of a user for receiving the user input may be provided.
  • other gestures in particular 3D gestures for selecting the display element are also possible.
  • a function of the means of transport associated with the file is called.
  • each display element on the headliner can assume a user-selectable position over a wide range, a particularly efficient screening of multimedia files and therefore rapid sorting thereof can take place. Prepared in this way, the files can provide a suitable basis for their later use.
  • the operation is particularly ergonomic, since the headliner of the means of transport is easier to touch by any occupant than a screen provided in the dashboard.
  • a second display element representing a second file may be displayed on the headliner of the vehicle.
  • this second display element can also be displayed on a screen provided on the headliner or projected onto the headliner.
  • a user input regarding the second display element may be received and in response thereto a function of the vehicle associated with the second file may be canceled.
  • the position of the second display element relative to the first display element can be optionally changed by the user in two dimensions. Such an operation supports intuitive sorting of displayed display elements or files.
  • the first or the second file can, for example, be an image file, in particular a photograph, preferably comprising a geographical position specification (geo tag).
  • the image file can be represented in particular by an example of a reduced representation of the image data or photography as a display element.
  • An audio / video or multimedia file can also be represented as the first and / or second file in the headliner.
  • a cover associated with the audio file or an image of the artist can be displayed for the intuitively comprehensible representation of the respective file.
  • the video file which includes a still image from the video material and / or a cover of a data carrier and / or a photograph of a participating actor.
  • the headliner may be divided into two contiguous surfaces, with the above-described interaction with the display elements taking place mainly on a first, horizontal surface.
  • the first surface at least partially surrounding, at least proportionately more inclined surface image files larger dimensions can be displayed.
  • geo-tags contained in the available image files can decide whether a respective image file is to be displayed as a function of the position and / or direction of travel of the means of transportation.
  • the position within the second area can be automatically selected and preferably continuously adjusted as a function of a current position (or direction) of the object shown in the file or the geo-tag position with respect to the current position of the means of locomotion.
  • the image file can be arranged starting from the vehicle center in the same direction as the imaged object or the geo-tag information.
  • the user input may include, for example, a drag & drop gesture, by means of which, in particular, a predefined target position is selected for a respective display element.
  • a drag & drop gesture by means of which, in particular, a predefined target position is selected for a respective display element.
  • a predefined target position is selected for a respective display element.
  • a video file (especially a photo with a geo-tag) may be moved to a corresponding predefined destination position to use the geographic indication within the video file as the destination address of a navigation system of the vehicle.
  • two files can be moved towards each other or to each other, for example, to create a playlist, or in the future to use a video file as the first file for an audio file as a second file as a display element.
  • the function called by the user interaction with the display element may for example be associated with a playback function or a playlist function of an infotainment system of the means of locomotion.
  • such related display elements may start such a function by which other similar titles are searched for in a local or Internet-based database and optionally added automatically (to the playlist or to the headliner).
  • the called function can be assigned to a navigation system by which a destination or an intermediate destination of a route guidance is defined and / or the route guidance is started. In this way, by means of simple gestures and without the use of a hierarchical menu, a quick access to functions of the means of locomotion can be taken without the driver being distracted from the traffic for a long time.
  • the method according to the invention may comprise transmitting a data record representing the first file from a memory of a mobile user terminal to the means of locomotion.
  • the record may be the first file itself.
  • a link to the relevant memory area of the mobile user terminal can be transmitted as a data record in order to transmit the file only in the case of a user-side function call or to use it directly from the mobile user terminal.
  • a predefined memory area of the means of locomotion in which similar files have already been stored at an earlier point in time can be described here.
  • the method may include displaying an icon for an infotainment system on the headliner.
  • a function called in connection with the display element may for example be associated with a playback function or a playlist function of an infotainment of the means of locomotion.
  • such related display elements may start such a function by which other similar titles are searched for in a local or Internet-based database and optionally automatically added.
  • the called function can be assigned to a navigation system by defining a destination or an intermediate destination of a route guidance and / or starting the route guidance. In this way, by means of simple gestures and without the use of a hierarchical menu, a quick access to functions of the means of locomotion can be taken without the driver being distracted from the traffic for a long time.
  • the method according to the invention may comprise transmitting a data record representing the first file from a memory of a mobile user terminal to the means of locomotion.
  • the record may be the first file itself.
  • a predefined memory area of the means of locomotion in which similar files have already been stored at an earlier point in time can be described here.
  • the transmission of the data can be done for example in a conventional manner by means of Bluetooth and / or WLAN.
  • the method may include displaying an icon for a playlist on the headliner.
  • the symbol may, for example, have free spaces which correspond to the contours of the display elements likewise shown on the roof lining (key-lock relationship).
  • the empty slots can be used as potential target positions for the display element to cause files associated with them to be displayed in the order shown.
  • the display principle (screen, projection or the like) for the symbol of the playlist may be, in particular, the same as that used for the display elements.
  • a symbol for a navigation function may be displayed in the same way, which represents a potential target position for the displayed display elements (in particular video files and contacts) for defining a route destination.
  • the symbol for the navigation function may have an empty space with such a contour, which corresponds to the contour of such display elements, which are suitable for defining a route destination.
  • music files that are not related to a geographical indication may have a round outline, while the potential destination position for the navigation function has a polygonal contour.
  • different contours for display elements representing different file types can be used to support an intuitive assignment by the user to offered functional scopes of the means of locomotion.
  • a current acceleration of the means of transport (longitudinal / transverse acceleration or deceleration) can be detected and in response to the first display element and / or the second display element, in particular any display elements and / or automatically move displayed symbols according to a virtual inertia associated with them.
  • an elastic suspension or fixation of the displayed display elements / symbols can be simulated, so that after the decay of the acceleration process, the display elements and / or symbols to return to their original position.
  • a decaying elastic process can be simulated to illustrate the individual mobility of the display elements. Users unfamiliar with the method according to the invention are playfully introduced in this way to the possibility of an operation according to the invention, without having to consult an instruction manual or to obtain an additional indication.
  • a context area to the first / second display element in which text information contained in the file (eg, a file name, meta-information, geo-tags, or the like) is displayed.
  • text information can be determined and added to the context area.
  • a search algorithm can derive from the files represented on the headliner a profile of interest of the respective user and, for example, give related information along a traveled route and / or up-to-date information on events of the artist. Such information can be obtained, for example, via the Internet. This online reference works, such. B. www.Wikipedia.org, are consulted.
  • locations lying along a predefined route can also be examined for a reference to the content of the file, and any references determined in the context area can be displayed.
  • a device for operating multimedia content in a means of transportation is proposed.
  • the means of transportation may be for example a car, a van, a truck, a land vehicle and / or aircraft.
  • the device comprises an input unit, an evaluation unit and a display unit.
  • the display unit can be designed, for example, as a projector.
  • the display unit may comprise a screen arranged on the headliner. It is set up to display a first display element representing a first file visually on the headliner of the means of locomotion.
  • the display elements form disjoint from each other over the headliner movable elements, which can be set by predefined user interaction in a desired relationship to each other.
  • the input unit is configured to detect a user input regarding the first display element. This may include, for example, a touching gesture on the displayed display element on the headliner. Alternatively or additionally, 3D executed freely in space can also be predefined for interaction with the displayed display elements.
  • the evaluation unit is set up to call a function of the means of transport associated with the file in response to the detected user input. In this case, a displacement of the display element in a predefined area (target position) or a change in a distance of a first display element from a second display element can cause the start of the function.
  • the device according to the invention is set up to carry out a method as has been described in detail in connection with the first-mentioned aspect of the invention.
  • the features, combinations of features and the advantages resulting therefrom corresponding to those of the method according to the invention can be seen in such a way that, in order to avoid repetition, reference is made to the above statements.
  • the device further comprises an interface for transferring files from a mobile user terminal to a memory of the means of transportation.
  • photos, audio and / or video files and address book entries can be represented according to the invention in the form of display elements on the headliner.
  • you can start phone calls, video calls, or conference calls by moving the contacts to a phone area (such as a phone icon or a virtual conference table).
  • a means of locomotion with a headliner and a device according to the second proposed aspect of the invention proposed.
  • the means of locomotion may in particular comprise a second and preferably a third row of seats, whereby the headliner provides a particularly large and therefore clear display unit. Sorting files in the form of display elements is greatly simplified in this way.
  • a computer program product eg, a data memory
  • the computer program product can be designed as a CD, DVD, Blueray disk, flash memory, hard disk, Ram / Rom, cache, etc.
  • a signal sequence representative of instructions that enable a programmable processor to perform the steps of a method according to the first aspect of the invention.
  • the information technology provision of the instructions is provided for the case under protection, that the storage means required for this purpose are outside the scope of the appended claims.
  • the programmable processor may for example be part of an evaluation unit of the device according to the invention or the means of transport according to the invention.
  • the display size of the display element be changed automatically. For example, display elements that have not been accessed for a long time can be reduced in size (miniaturized or dot-shaped) and enlarged ("brought to the foreground") by user interaction. In this way, the overview remains despite one considerable variety displayed display elements situation-related.
  • FIG. 1 shows a device 20 for handling multimedia content in a means of transportation.
  • the multimedia content is transmitted wirelessly from a smartphone 4 to an electronic control unit 5 as an evaluation unit. Subsequently, they are stored in a data memory 6.
  • a Input unit 12 is set up to detect user interactions with display elements projected on a headliner 2 via a projector 7 (not shown).
  • the projector 7 is designed as a short throw projector, which is why the light emitted by him 8 illuminates the headliner wide angle.
  • FIG. 2 shows the interior of a car 10 as a means of transport, at the headliner 2 album cover 1 a, 1 b, 1 c, 1 d, 1 e, 1 f are projected as display elements.
  • a context area 11 represents in text form further information about the music file represented by the album cover 1 b. The information in the context area 11 has aroused the interest of a user 9, who interacts with the album cover 1 b by means of his hand 9 a to additional To display information.
  • a display area 3 as a symbol is provided in the form of a circular-disk-shaped projection with free circular shapes 3 a, 3 b as a predefined target position for display elements. Two album covers 1 e, 1 f have already found their way into the symbol 3 and wait for the music files linked to them to be played back.
  • FIG. 3 shows a projected to a headliner 2 display element 1 a, which is moved by the hand 9 a of a user along an arrow P to a new position in the direction of a display area 3 as a symbol.
  • FIG. 4 shows a gesture with the hand 9 a of a user, by means of which a display element 1 a in the direction of a second display element 1 b along an arrow P is moved. While the movement of the hand at the position of the dashed line position of the hand 9 a 'ends, a virtual inertia of the display element 1 a causes the display element 1 a further slips in the direction of the second display element 1 b, where it finally elastic with this clashes.
  • FIG. 5 shows an embodiment of a means 10 according to the invention, in which video files 1 a, 1 b, 1 c, 1 d, 1 e, 1 f displayed as display elements on the headliner 2 and moved by the hands 9 a of the occupant 9.
  • a compass 3 is displayed as a symbol for a navigation system. If one of the images 1 a, 1 b, 1 c, 1 d, 1 e, 1 f shifted to the compass 3, the device asks the user, whether in the by the video file 1 a, 1 b, 1 c, 1 d, 1 e, 1 f file included geo-tag is to be used as destination coordinates for a route guidance. If the user confirms the query, he is next asked if the route guidance should be started. If the user also accepts this query, the route guidance starts immediately.
  • FIG. 6 shows steps of an embodiment of a method according to the invention for operating multimedia content in a means of transportation.
  • a user connects his smartphone as a mobile user terminal with a communication device of the means of locomotion. If the user confirms a request for transmission of multimedia files to the means of locomotion, in step 200 the transmission of the files to a memory of the means of locomotion starts.
  • display elements representing the multimedia files are generated and projected onto the headliner of the vehicle.
  • a user input is received regarding one of the displayed display elements. In this case, the user moves the display element to a predefined target position, whereby the desired function is called with respect to the associated file.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
EP15181245.0A 2014-08-21 2015-08-17 Dispositif et procede d'utilisation de contenus multimedia dans un moyen de transport Not-in-force EP2990251B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102014216661.6A DE102014216661A1 (de) 2014-08-21 2014-08-21 Vorrichtung und Verfahren zur Bedienung von Multimedia-Inhalten in einem Fortbewegungsmittel

Publications (3)

Publication Number Publication Date
EP2990251A2 true EP2990251A2 (fr) 2016-03-02
EP2990251A3 EP2990251A3 (fr) 2016-11-16
EP2990251B1 EP2990251B1 (fr) 2018-01-31

Family

ID=54065674

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15181245.0A Not-in-force EP2990251B1 (fr) 2014-08-21 2015-08-17 Dispositif et procede d'utilisation de contenus multimedia dans un moyen de transport

Country Status (3)

Country Link
EP (1) EP2990251B1 (fr)
CN (1) CN105383411B (fr)
DE (1) DE102014216661A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3399762B1 (fr) * 2017-05-02 2023-07-12 Harman International Industries, Incorporated Hub portable avec enregistreur vidéo numérique

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017202483B4 (de) 2017-02-16 2023-02-09 Audi Ag Verfahren zur Darstellung von Informationen für einen Nutzer eines Fahrzeugs und Projektionssystem zum Darstellen von Informationen in einem Fahrzeug
IT201700091628A1 (it) * 2017-08-08 2019-02-08 Automotive Lighting Italia Spa Sistema di interfaccia uomo-macchina virtuale e corrispondente procedimento di interfaccia uomo-macchina virtuale per un veicolo.
DE102018201267A1 (de) * 2018-01-29 2019-08-01 Bayerische Motoren Werke Aktiengesellschaft Transportmittel und Projektionsfläche für die Verwendung in einem Transportmittel
DE102021132228A1 (de) 2021-12-08 2023-06-15 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Kraftfahrzeug
DE102022100137A1 (de) * 2022-01-04 2023-07-06 Bayerische Motoren Werke Aktiengesellschaft Verfahren für ein Fortbewegungsmittel zur Verwendung einer berührungsempfindlichen Eingabevorrichtung für eine Streaming-Box

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006130543A2 (fr) 2005-06-02 2006-12-07 Johnson Controls Technology Company Systeme de toit pour vehicule
EP1798588A1 (fr) 2005-12-13 2007-06-20 GM Global Technology Operations, Inc. Système de commande des fonctions dans un véhicule automobile

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6649848B2 (en) * 2001-09-04 2003-11-18 Yefim G. Kriger Vehicle with on-board dieters' weight progress indentifying and control system and method
DE102009051202A1 (de) * 2009-10-29 2011-05-12 Volkswagen Ag Verfahren zum Betreiben einer Bedienvorrichtung und Bedienvorrichtung
US20130145401A1 (en) * 2011-11-16 2013-06-06 Flextronics Ap, Llc Music streaming
US8924150B2 (en) * 2010-12-29 2014-12-30 GM Global Technology Operations LLC Vehicle operation and control system for autonomous vehicles on full windshield display
WO2012134479A1 (fr) * 2011-03-31 2012-10-04 Hewlett-Packard Development Company, L.P. Augmentation d'éléments d'interface utilisateur
US8941690B2 (en) * 2011-12-09 2015-01-27 GM Global Technology Operations LLC Projected rear passenger entertainment system
US8733938B2 (en) * 2012-03-07 2014-05-27 GM Global Technology Operations LLC Virtual convertible tops, sunroofs, and back windows, and systems and methods for providing same

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006130543A2 (fr) 2005-06-02 2006-12-07 Johnson Controls Technology Company Systeme de toit pour vehicule
EP1798588A1 (fr) 2005-12-13 2007-06-20 GM Global Technology Operations, Inc. Système de commande des fonctions dans un véhicule automobile

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3399762B1 (fr) * 2017-05-02 2023-07-12 Harman International Industries, Incorporated Hub portable avec enregistreur vidéo numérique

Also Published As

Publication number Publication date
EP2990251B1 (fr) 2018-01-31
CN105383411B (zh) 2019-01-01
EP2990251A3 (fr) 2016-11-16
DE102014216661A1 (de) 2016-02-25
CN105383411A (zh) 2016-03-09

Similar Documents

Publication Publication Date Title
EP2990251B1 (fr) Dispositif et procede d'utilisation de contenus multimedia dans un moyen de transport
EP2350799B1 (fr) Procédé et dispositif d'affichage d'informations ordonnées sous forme de liste
EP3092143B1 (fr) Module de commande d'affichage et procédé d'affichage d'indications supplémentaires sur un module d'affichage
EP3116737B1 (fr) Procédé et dispositif servant à fournir une interface graphique d'utilisateurs dans un véhicule
DE102018207440A1 (de) Verfahren zur Berechnung einer "augmented reality"-Einblendung für die Darstellung einer Navigationsroute auf einer AR-Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
DE102009036371A1 (de) Verfahren und Vorrichtung zum Bereitstellen einer Benutzerschnittstelle
DE102021121821A1 (de) Systeme und verfahren für digitale virtuelle blickfeld-lenkradsteuerung
EP3040849B1 (fr) Moyen de transport, interface utilisateur et procédé destiné à faire chevaucher un contenu d'affichage sur deux dispositifs d'affichage
DE102014208663A1 (de) Vorrichtung und verfahren zur bereitstellung von informationsdaten zu einem in einem videobildstrom enthaltenen objekt einer fahrzeugumgebung
EP2930049A1 (fr) Interface utilisateur et procédé d'adaptation d'une vue sur une unité d'affichage
EP3097468A1 (fr) Interface utilisateur, et procédé pour l'adaptation d'une vue sur une unité d'affichage
EP2943866B1 (fr) Procédé et dispositif permettant de fournir une interface utilisateur dans un véhicule
DE102014211342A1 (de) Anwenderschnittstelle und Verfahren zum Anpassen einer semantischen Skalierung einer Kachel
WO2017108858A1 (fr) Procédé et système pour la génération et la gestion coopérative d'un plan de voyage
EP2424744B1 (fr) Procédé pour commander l'affichage d'informations sur une surface d'affichage
EP2987066B1 (fr) Véhicule à moteur équipé d'un dispositif d'affichage et de commande, et procédé correspondant
DE102006032117A1 (de) Informationssystem für ein Verkehrsmittel und Verfahren zum Steuern eines solchen Informationssystems
EP2718672B1 (fr) Procédé et dispositif pour la préparation d'une interface utilisateur
EP3074265B1 (fr) Recherche dans l'ensemble du système dans des systèmes d'information au conducteur
DE102016207530B4 (de) System und Verfahren zum Darstellen eines virtuellen Fahrzeuginnenraums
EP2925552A2 (fr) Procédé de commande et système de commande dans un véhicule routier
DE102011121108A1 (de) Verfahren und Vorrichtungen zum Ausgeben von Informationen in einem Fahrzeug
DE102009036368A1 (de) Verfahren und Vorrichtung zum Bereitstellen einer Benutzerschnittstelle in einem Fahrzeug
EP2927043B1 (fr) Procédé et système de commande dans un véhicule
EP3749540B1 (fr) Dispositif de commande ainsi que procédé et support de stockage lisible par ordinateur comportant des instructions pour la configuration d'un dispositif de commande

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: SKYTTE, JONAS GOTTLIEB

Inventor name: AMBY, MORTEN DAHL

Inventor name: IVERSEN, LASSE

Inventor name: ANDERSEN, DAVID MOELLER

Inventor name: QUAST, TOM

Inventor name: WOELFEL, CHRISTIANE

Inventor name: SOERENSEN, TOR

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: H04B 10/114 20130101ALI20161012BHEP

Ipc: B60K 37/06 20060101ALI20161012BHEP

Ipc: H04M 1/725 20060101ALI20161012BHEP

Ipc: G01C 21/36 20060101ALI20161012BHEP

Ipc: H04N 21/41 20110101ALI20161012BHEP

Ipc: B60K 35/00 20060101AFI20161012BHEP

Ipc: H04M 1/60 20060101ALI20161012BHEP

Ipc: H04N 21/414 20110101ALI20161012BHEP

Ipc: G06F 3/01 20060101ALI20161012BHEP

17P Request for examination filed

Effective date: 20170516

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170821

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 967022

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502015002952

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180131

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180430

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180501

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180531

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180430

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502015002952

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20181102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180831

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180831

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180817

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180831

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180831

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180131

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150817

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190817

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 967022

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200817

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230523

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230831

Year of fee payment: 9

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502015002952

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250301