WO2014109694A2 - Prise en charge et amélioration de localisation à base d'image - Google Patents
Prise en charge et amélioration de localisation à base d'image Download PDFInfo
- Publication number
- WO2014109694A2 WO2014109694A2 PCT/SE2013/051621 SE2013051621W WO2014109694A2 WO 2014109694 A2 WO2014109694 A2 WO 2014109694A2 SE 2013051621 W SE2013051621 W SE 2013051621W WO 2014109694 A2 WO2014109694 A2 WO 2014109694A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- positioning
- image
- wireless device
- image data
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
- H04W64/006—Locating users or terminals or network equipment for network management purposes, e.g. mobility management with additional information processing, e.g. for direction or speed determination
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0257—Hybrid positioning
- G01S5/0263—Hybrid positioning by combining or switching between positions derived from two or more separate positioning systems
- G01S5/0264—Hybrid positioning by combining or switching between positions derived from two or more separate positioning systems at least one of the systems being a non-radio wave positioning system
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/12—Acquisition of 3D measurements of objects
Definitions
- the technical field of the present disclosure generally relates to wireless communications networks and in particular to networks supporting positioning based on images.
- LTE Long Term Evolution
- WCDMA Wideband Code Division Multiple Access
- WiMax Microwave Access
- UMB Ultra Mobile Broadband
- GSM Global System for Mobile communications
- Terminals are also known as e.g. User Equipments (UE), mobile terminals, wireless terminals and/or mobile stations. Terminals are enabled to communicate wirelessly in a cellular communications network or wireless
- the communication may be performed e.g. between two terminals, between a terminal and a regular telephone and/or between a terminal and a server via a Radio Access Network (RAN) and possibly one or more core networks, comprised within the cellular communications network.
- RAN Radio Access Network
- Terminals may further be referred to as mobile telephones, cellular telephones, laptops, or surf plates with wireless capability, just to mention some further examples.
- the terminals in the present context may be, for example, portable, pocket-storable, handheld, computer-comprised, or vehicle-mounted mobile devices, enabled to communicate voice and/or data, via the RAN, with another entity, such as another terminal or a server.
- the cellular communications network covers a geographical area which is divided into cell areas, wherein each cell area being served by an access node such as a base station, e.g. a Radio Base Station (RBS), which sometimes may be referred to as e.g. "eNB”, “eNodeB”, “NodeB”, “B node”, or BTS (Base Transceiver Station), depending on the technology and terminology used.
- a base station e.g. a Radio Base Station (RBS)
- eNB Radio Base Station
- eNodeB eNodeB
- NodeB Node
- B node BTS (Base Transceiver Station)
- the base stations may be of different classes such as e.g. macro eNodeB, home eNodeB or pico base station, based on transmission power and thereby also cell size.
- a cell is the geographical area where radio coverage is provided by the base station at a base station site.
- One base station, situated on the base station site may serve one or
- each base station may support one or several communication technologies.
- the base stations communicate over the air interface operating on radio frequencies with the terminals within range of the base stations.
- the expression Downlink (DL) is used for the transmission path from the base station to the mobile station.
- the expression Uplink (UL) is used for the transmission path in the opposite direction i.e. from the mobile station to the base station.
- base stations which may be referred to as eNodeBs or even eNBs, may be directly connected to one or more core networks.
- 3GPP LTE radio access standard has been written in order to support high bitrates and low latency both for uplink and downlink traffic. All data transmission is in LTE controlled by the radio base station.
- the possibility to determine the position of a mobile device has enabled application developers and wireless network operators to provide location based, and location aware, services. Examples of those are guiding systems, shopping assistance, friend finder, presence services, community and communication services and other information services giving the mobile user information about their surroundings.
- GPS Global Positioning System
- GNSS Global Navigation Satellite System
- CID Cell IDentifier
- E-CID Enhanced CID
- AoA network-based Angle-of-Arrival
- A-GNSS Assisted-Global Navigation Satellite System
- A-GPS Assisted GPS
- OTDOA Observed Time Difference of Arrival
- Time Difference of Arrival (TDOA)-/Time of Arrival (TOA)-based methods e.g., OTDOA, UTDOA or GNSS/A-GNSS
- OTDOA Time Difference of Arrival
- TOA Time of Arrival
- a typical format of the positioning result is an ellipsoid point with uncertainty circle/ellipse/ellipsoid which is the result of intersection of multiple hyperbolas/hyperbolic arcs, e.g., OTDOA, or circles/arcs, e.g., UTDOA, GNSS, or A-GNSS.
- Hybrid methods Since the hybrid technique involves a mix of any of the methods above, the position result can be any shape, but in many cases it is likely to be a polygon.
- Anchor nodes' locations e.g., eNodeB or beacon device locations for OTDOA, Location Measurement Units (LMU) antenna locations for UTDOA, eNodeB locations for E-CID.
- LMU Location Measurement Units
- the anchor nodes' location may also be used to enhance Adaptive Enhanced Cell ID (AECID), hybrid positioning, etc.
- AECID Adaptive Enhanced Cell ID
- Image Recognition Based Positioning uses image feature analysis in the target device or on the location server to determine, or help determine, the target device's position.
- the IRBP is being standardized by the Open Mobile Alliance (OMA) group and will also be possible via a 3GPP interface.
- OMA Open Mobile Alliance
- the three key network elements in an LTE positioning architecture are the
- LCS Location Service
- the LCS Server is a physical or logical entity managing positioning for a LCS target device by collecting measurements and other location information, assisting the terminal in measurements when necessary, and estimating the LCS target location.
- a LCS Client is a software and/or hardware entity that interacts with a LCS Server for the purpose of obtaining location information for one or more LCS targets, i.e., the entities being positioned.
- LCS Clients may reside in a network node, external node, Public Safety Answering Point (PSAP), UE, radio base station, etc., and they may also reside in the LCS targets themselves.
- PSAP Public Safety Answering Point
- An LCS Client e.g., an external LCS Client, sends a request to LCS Server, e.g., positioning node, to obtain location information, and LCS Server processes and serves the received requests and sends the positioning result and optionally a velocity estimate to the LCS Client.
- LCS Server e.g., positioning node
- Position calculation can be conducted, for example, by a positioning server, e.g.,
- E-SMLC Evolved- Serving Mobile Location Center
- SLP Secure Location Platform
- UE-assisted positioning calculation is in a positioning network node based on measurements received from UE
- LMU-assisted calculation is in a positioning network node based on
- Figure 1 illustrates the UL positioning architecture in LTE.
- Figure 1 illustrates the UTDOA architecture being currently discussed in 3GPP.
- UL measurements may in principle be performed by any radio network node, e.g., eNodeB
- UL positioning architecture may include specific UL measurement units e.g., LMUs, which e.g., may be logical and/or physical nodes, may be integrated with radio base stations or sharing some of the software or hardware equipment with radio base stations or may be completely standalone nodes with own equipment, including antennas.
- LMUs specific UL measurement units
- the architecture is not finalized yet, but there may be communication protocols between LMU and positioning node, and there may be some enhancements for LTE Positioning Protocol Annex (LPPa) or similar protocols to support UL positioning.
- LPPa LTE Positioning Protocol Annex
- a new interface, SLm, between the E-SMLC and LMU is being standardized for uplink positioning.
- the interface is terminated between a positioning server, E-SMLC, and LMU. It is used to transport SLmAP protocol, new protocol being specified for UL positioning) messages over the E-SMLC-to-LMU interface.
- E-SMLC positioning server
- LMU LMU deployment options are possible.
- an LMU may be a standalone physical node, it may be integrated into eNodeB or it may be sharing at least some equipment such as antennas with eNodeB - these three options are illustrated in the Figure 1.
- LPPa is a protocol between eNodeB and LCS Server specified only for control plane positioning procedures, although it still can assist user plane positioning by querying eNodeBs for information and eNodeB measurements. LPPa may be used for DL positioning and UL positioning.
- SRS Sounding Reference Signals
- LMU needs a number of SRS parameters to generate the SRS sequence which is to be correlated to received signals.
- the SRS parameters would have to be provided in the assistance data transmitted by positioning node to LMU; these assistance data would be provided via SLmAP, a.k.a. LMUp.
- these parameters may generally be not known to the positioning node, which needs then to obtain this information from eNodeB configuring the SRS to be transmitted by the UE and measured by LMU; this information would have to be provided in LPPa or similar protocol.
- UTDOA Another example of UL positioning, except UTDOA, is e.g., E-CID positioning based on UL measurements.
- DL positioning in LTE is illustrated.
- Some examples of DL positioning are OTDOA and E-CID based on DL measurements.
- Position calculation may be performed in the device or in a network node.
- a wireless device may be provided with assistance data, e.g., OTDOA assistance data comprises a list of cells to be measured, radio signals configuration for the measurements, approximate timing, etc...
- the assistance data is provided via the LTE Positioning Protocol (LPP) protocol, between positioning server and target UE.
- LPP may also embed LPP extensions (LPPe) to convey additional information
- LPPe may also be used for user-plane positioning via Secure User Plane Location (SUPL) for LTE, GSM, Code Division Multiple Access (CDMA), and WCDMA.
- SUPL Secure User Plane Location
- CDMA Code Division Multiple Access
- WCDMA Wideband Code Division Multiple Access
- eNodeBs e.g., LPPa protocol
- positioning node may also obtain some information from Operation and Maintenance (O&M).
- O&M Operation and Maintenance
- QoS Quality of Service
- Positioning QoS normally refers to two aspects of requirement: positioning accuracy and response time. Positioning QoS should not be confused with positioning measurements QoS, where the latter also impacts the achieved positioning result QoS. The importance of each of the two quality characteristics is that they are generally service- and LCS application dependent. Often the positioning accuracy is of a more importance and typically it is the bottleneck in implementation.
- the positioning node when a positioning request arrives from the end user to the positioning node, a decision on which positioning method to use needs to be taken.
- the positioning node then needs to look up prior accuracies of the available positioning methods and compared these to the signaled requested accuracy from the end user, in order to select a most suitable positioning method. Then when a positioning results is available, the achieved accuracy is computed in the positioning node and it is determined if the requested accuracy was met. If so the positioning node reports the result and possibly the accuracy, back to the end user. If not met, the positioning node may proceed with a positioning re- attempt or another positioning method.
- Positioning QoS may be of two types:
- Target positioning QoS a.k.a. target LCS quality
- MME Mobility Management Entity
- Positioning result QoS or positioning result quality should be distinguished from positioning measurement quality. There may be multiple measurements used for positioning of the same UE, and each measurement is characterized with own quality. The set of measurements and their qualities may also impact the positioning result quality, but measurement quality is not the same as the positioning result quality.
- the disclosed subject matter includes at least the following non-limiting aspects: methods of using image data for positioning, Embodiment herein 1 ; methods of position estimation based on at least two images, Embodiment herein 2; methods of enhanced information signaling to support image-based positioning, Embodiment herein 3; and methods of obtaining positioning result QoS characteristics for a positioning result obtained with image-based positioning, Embodiment herein 4.
- Embodiments herein 1-4 may be combined in any way and in any order. Further, the solutions, unless specifically indicated otherwise, are not limited to any specific image-based positioning approach.
- the object is achieved by a method in the radio communications network of using image data for positioning a first wireless device.
- the first wireless device operates in the radio communications network.
- the method comprises obtaining image data.
- the image data comprises at least two image objects and an angle between lines formed between each of the objects and a reference point.
- the method further comprises extracting the at least two image objects from the obtained image data.
- the method also comprises determining, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the method further comprises, using the at least two image objects and/or the image data for positioning the first wireless device based on the determined angle.
- the method is performed by at least one of: a network node, the first wireless device, a camera device, a second wireless device, an image processing node and a server, each operating in the radio communications network.
- the object is achieved by a method performed by a positioning node of using the image data for positioning the first wireless device.
- the positioning node and the first wireless device operate in the radio communications network.
- the positioning node obtains the capability data associated with image-based positioning from one of: the network node, the first wireless device, the second wireless device, the camera device, the image processing node and the server, each operating in the radio communications network.
- the positioning node selects the image-based positioning method based on the obtained capability.
- the positioning node further obtains the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point from the one of: the network node, the first wireless device, the second wireless device, the camera device, the image processing node and the server.
- the image data comprises the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the positioning node uses the at least two image objects and/or the image data for positioning the first wireless device.
- the object is achieved by the network node for using the image data for positioning the first wireless device.
- the network node and the first wireless device are configured to operate in the radio communications network.
- the network node is configured to obtain the image data comprising the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the network node is further configured to extract the at least two image objects from the obtained image data.
- the network node is also configured to determine, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the network node is further configured to use the at least two image objects and/or the image data for positioning the first wireless device based on the determined angle.
- the object is achieved by the wireless device for using the image data for positioning the first wireless device.
- the wireless device and the first wireless device are configured to operate in the radio communications network.
- the wireless device is configured to obtain the image data comprising the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the wireless device is further configured to extract the at least two image objects from the obtained image data.
- the wireless device is also configured to determine, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the wireless device is further configured to use the at least two image objects and/or the image data for positioning the first wireless device based on the determined angle.
- the object is achieved by the positioning node for using the image data for positioning the first wireless device.
- the positioning node and the first wireless device are configured to operate in the radio communications network.
- the positioning node is configured to obtain the capability data associated with image-based positioning from the one of: the network node, the first wireless device, the second wireless device, the camera device, the image processing node and the server, each configured to operate in the radio communications network.
- the positioning node is further configured to select an image-based positioning method based on the obtained capability.
- the positioning node is also configured to obtain the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point from the one of: the network node, the first wireless device, the second wireless device, the camera device, the image processing node and the server.
- the image data comprises the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the positioning node is further configured to use the at least two image objects and/or the image data for positioning the first wireless device.
- the object is achieved by a computer program comprising instructions.
- the instructions when executed on at least one processor, cause the at least one processor to carry out the method performed by the network node.
- the object is achieved by a computer program comprising instructions.
- the instructions when executed on at least one processor, cause the at least one processor to carry out the method performed by the first wireless device.
- the object is achieved by a computer program comprising instructions.
- the instructions when executed on at least one processor, cause the at least one processor to carry out the method performed by the positioning node.
- the object is achieved by a computer-readable storage medium.
- the computer-readable storage medium has stored thereon the computer program comprising the instructions that, when executed on at least one processor, cause the at least one processor to carry out the method performed by the network node.
- the object is achieved by a computer-readable storage medium.
- the computer-readable storage medium has stored thereon the computer program comprising the instructions that, when executed on at least one processor, cause the at least one processor to carry out the method performed by the first wireless device.
- the object is achieved by a computer-readable storage medium.
- the computer-readable storage medium has stored thereon the computer program comprising the instructions that, when executed on at least one processor, cause the at least one processor to carry out the method performed by the positioning node.
- Figure 1 is a schematic diagram illustrating UL positioning architecture in LTE.
- Figure 2 is a schematic diagram illustrating DL positioning architecture in LTE.
- Figure 3 is a schematic overview of embodiments in the radio communications network.
- Figure 4 is a schematic flow chart illustrating a method in a radio communications
- Figure 5 is a schematic flow chart illustrating a method in a positioning node according to embodiments herein.
- Figure 6 is a block diagram depicting a network node according to embodiments herein.
- Figure 7 is a block diagram depicting embodiments of a wireless device according to embodiments herein.
- Figure 8 is a block diagram depicting embodiments of a positioning node according to embodiments herein.
- Figure 9a is a schematic diagram illustrating an example of a device two pairs of pictures:
- Figure 9b illustrates an example of the two pairs of pictures: A,C and B,D according to embodiments herein.
- Figure 10a is a schematic diagram illustrating an example of finding a 2D position of the device, according to embodiments herein.
- Figure 10b is a schematic diagram illustrating an example of finding a 3D position of the device, e.g., a vertical line, according to embodiments herein.
- Figure 1 1 is a schematic diagram illustrating an example of finding a 3D position of the device when vertical angles are unknown, according to embodiments herein.
- Figure 12 is a schematic diagram illustrating an example of hybrid positioning based on two pictures, taken at 180°, and a timing and/or distance measurement, forming an intersecting arc, according to embodiments herein.
- Figure 13 is a schematic diagram illustrating an example of finding a 3D position, small circle, of the device using hybrid positioning, e.g., with timing/distance measurement, according to embodiments herein.
- Figure 14 is a schematic diagram illustrating an example of finding a 2D position of the device, uncertainty polygon in bold - an intersection of the two strips, according to embodiments herein.
- Figure 15 is a block diagram depicting a network node according to embodiments herein.
- Figure 16 is a block diagram depicting a network node according to embodiments herein.
- Figure 17 is a block diagram depicting embodiments of a positioning node according to embodiments herein.1
- Figure 18 is a block diagram depicting embodiments of a positioning node according to embodiments herein
- Figure 19 is a block diagram depicting embodiments of a measuring node according to embodiments herein.
- Figure 20 is a block diagram depicting embodiments of a measuring node according to embodiments herein.
- Figure 21 is a block diagram depicting embodiments of a coordinating node according to embodiments herein.
- Figure 22 is a block diagram depicting embodiments of a coordinating node according to embodiments herein.
- Figure 23 is a block diagram depicting embodiments of a wireless device according to embodiments herein.
- Figure 24 is a block diagram depicting embodiments of a wireless device according to embodiments herein.
- FIG. 3 is a schematic overview of a radio communications network 300 in which embodiments herein may be implemented.
- the radio communications network 300 may for example be a network such as a Long-Term Evolution (LTE), e.g. LTE Frequency Division Duplex (FDD), LTE Time Division Duplex (TDD), LTE Half- Duplex Frequency Division Duplex (HD-FDD), LTE operating in an unlicensed band.
- LTE Long-Term Evolution
- FDD Frequency Division Duplex
- TDD Time Division Duplex
- HD-FDD LTE Half- Duplex Frequency Division Duplex
- LTE operating in an unlicensed band.
- the described embodiments are not limited to LTE, but may apply with any RAN, single- or multi- Radio Access Technologies (RAT).
- RAT Radio Access Technologies
- Some other RAT examples are LTE-Advanced, Universal Mobile Telecommunications System (UMTS), High-Speed Packet Access (HSPA), Global System for Mobile communications (GSM) network, Code Division Multiple Access 2000 (cdma2000), Worldwide Interoperability for Microwave Access (WiMax), WiFi, Wideband Code Division Multiple Access (WCDMA), Universal Terrestrial Radio Access (UTRA) TDD, GSM/Enhanced Data Rate for GSM Evolution (EDGE) Radio Access Network (GERAN) network, Ultra-Mobile Broadband (UMB), EDGE network, network comprising of any combination of Radio Access Technologies (RATs) such as e.g.
- RATs Radio Access Technologies
- Multi-Standard Radio (MSR) base stations multi-RAT base stations etc., any 3rd Generation Partnership Project (3GPP) cellular network, 5G system or any cellular network or system.
- 3GPP LTE 3rd Generation Partnership Project LTE
- the radio communications network 300 comprises a network node 310.
- the network node 310 may be any radio network node, see the corresponding description, as depicted in Figure 3, or core network node.
- the network node 310 may be, for example, a base station such as e.g. an eNB, eNodeB, or a Home Node B, a Home eNode B, femto Base Station, BS, pico BS or any other network unit capable to serve a device or a machine type communication device in a radio communications network 300.
- the network node 310 may be a stationary relay node or a mobile relay node.
- the radio communications network 300 covers a geographical area which is divided into cell areas, wherein each cell area is served by a network node, although, one network node may serve one or several cells.
- the network node 310 provides radio coverage over at least one geographical area forming a cell 320.
- the network node 310 may be of different classes, such as e.g. macro eNodeB, home eNodeB or pico base station, based on transmission power and thereby also cell size.
- the network node 310 may support one or several communication technologies, and its name may depend on the technology and terminology used.
- the network node 310 are also a radio network node, Radio Network Controller (RNC), positioning node, MME, PSAP, Self-Optimized Network (SON) node, Minimization of Drive Tests (MDT) node, coordinating node, a gateway node, e.g., Packet Data Network Gateway (PGW) or Serving Gateway (SGW) or LMU gateway or femto gateway, and O&M node.
- RNC Radio Network Controller
- MME Mobility Management Entity
- PSAP Self-Optimized Network
- MDT Minimization of Drive Tests
- coordinating node e.g., a gateway node, e.g., Packet Data Network Gateway (PGW) or Serving Gateway (SGW) or LMU gateway or femto gateway, and O&M node.
- PGW Packet Data Network Gateway
- SGW Serving Gateway
- LMU gateway femto gateway
- coordinating node may be a network and/or node, which coordinates radio resources with one or more radio nodes.
- Some examples of the coordinating node are network monitoring and configuration node, Operational Support System (OSS) node, O&M, MDT node, SON node, positioning node, MME, a gateway node such as PGW or SGW network node or femto gateway node, a macro node coordinating smaller radio nodes associated with it, eNodeB coordinating resources with other eNodeBs, etc.
- OSS Operational Support System
- the radio communications network 300 comprises more network nodes such as network node 310. This is not depicted in Figure 3 for the sake of simplicity.
- another network node refers to a network node just as network node 310, that is not the network node 310.
- a number of wireless devices are located in the radio communications network 300. In the example scenario of Figure 3, two wireless devices are shown, a first wireless device 331 and a second wireless device 332.
- Each of the first wireless device 331 and the second wireless device 332 is a wireless communication device such as a UE, which is also known as e.g. mobile terminal, wireless terminal and/or mobile station.
- Each of the first wireless device 331 and the second wireless device 332 is wireless, i.e., it is enabled to communicate wirelessly in the radio communications network 300.
- the communication may be performed e.g., between two devices, such as the first wireless device 331 and the second wireless device 332, between a device and a regular telephone and/or between a device and a server.
- the communication may be performed e.g., via a RAN and possibly one or more core networks, comprised within the radio communications network 300.
- Each of the first wireless device 331 and the second wireless device 332 may further be referred to as a mobile telephone, cellular telephone, or laptop with wireless capability, just to mention some further examples.
- Each of the first wireless device 331 and the second wireless device 332 in the present context may be, for example, portable, pocket-storable, hand-held, computer-comprised, or vehicle-mounted mobile devices, enabled to communicate voice and/or data, via the RAN, with another entity, such as a server, a laptop, a Personal Digital Assistant (PDA), or a tablet computer, sometimes referred to as a surf plate with wireless capability, Machine-to-Machine (M2M) devices, devices equipped with a wireless interface, such as a printer or a file storage device or any other radio network unit capable of communicating over a radio link in a cellular communications system.
- M2M Machine-to-Machine
- wireless device such as the first wireless device 331 and the second wireless device 332, and UE are used interchangeably.
- any reference to a UE herein will be understood to apply to a wireless device such as any of the first wireless device 331 and the second wireless device 332, unless specific references are made to the first wireless device 331 , or the second wireless device 332.
- any reference herein to the wireless device 331 , 332 will be understood to refer to any of the first wireless device or the second wireless device 332, unless noted otherwise.
- a UE, such as the first wireless device 331 and the second wireless device 332 can be any device equipped with a radio interface and capable of at least transmitting to and/or receiving radio signals from another radio node.
- a UE such as the first wireless device 331 and the second wireless device 332, may also be capable of receiving signal and demodulate it.
- radio network nodes e.g., femto BS, a.k.a. home BS
- UE may also be equipped with a UE-like interface.
- Some example of "UE” that are to be understood in a general sense are Personal Digital Assistant (PDA), laptop, mobile, a tablet device, sensor, fixed relay, mobile relay, any radio network node equipped with a UE-like interface, e.g., small RBS, eNodeB, femto BS.
- PDA Personal Digital Assistant
- a wireless device such as the first wireless device 331 and the second wireless device 332 is one example of a device.
- Another example of the device is a device capable of taking and/or processing pictures, which may be comprised in a wireless device, such as the first wireless device 331 , may be able to communicate with another device, such as the second wireless device 332, may or may not have a wireless interface, where the wireless interface may also be a short-range communication radio interface in some examples.
- the network node 310 may communicate with the first wireless device 331 over a first radio link 341 , and with the second wireless device 332 over a second radio link 342.
- the first wireless device 331 and the second wireless device 332 may
- the radio communications network 300 may comprise a positioning node 350.
- the positioning node 350 described in different embodiments may be a node with positioning functionality.
- the positioning node 350 may be a physical and/or logical node.
- SLP may be understood as a positioning platform in the user plane, e.g., SLP in LTE, or a positioning node in the control plane, e.g., E-SMLC in LTE.
- SLP may also consist of SUPL Location Centre (SLC) and SPC, where SPC may also have a proprietary interface with E-SMLC.
- Positioning functionality may also be split among two or more nodes, e.g., there may be a gateway node between LMUs and E-SMLC, where the gateway node may be a radio base station or another network node; in this case, the term "positioning node" may relate to E-SMLC and the gateway node.
- a positioning node may be a simulator or emulating test equipment.
- positioning node may also be used interchangeably with "positioning server” which may be any node configured as a positioning server, e.g., a wireless device, such as the first wireless device 331 and the second wireless device 332, or the network node 310, e.g., eNodeB, E-SMLC or SLP.
- a radio node may be characterized by its ability to transmit and/or receive radio signals and it comprises at least a transmitting or receiving antenna.
- radio nodes include a UE, such as the first wireless device 331 and the second wireless device 332, and a radio network node, such as the network node 310, see the corresponding descriptions.
- a radio network node may be a radio node comprised in the radio communications network 300.
- the radio network node may be capable of receiving and/or transmitting radio signals in one or more frequencies, and may operate in single-Radio Access
- the radio network node including the network node 310, eNodeB, Remote Radio Head (RRH), Remote Radio Unit (RRU), or transmitting-only and/or receiving-only radio network nodes, may or may not create its own cell, such as the cell 320.
- Some examples of radio network nodes not creating their own cell include beacon devices, which may transmit configured radio signals, and measuring nodes, which may receive and perform measurements on certain signals, e.g., LMUs.
- Such radio network node may also share cell or use the cell I Dentifier (ID) with another radio node which creates its own cell, such as the cell 320, and/or it may operate in a cell sector or may be associated with a radio network node creating own cell, such as network node 310 which creates its own cell 320.
- ID cell I Dentifier
- one or more serving cells may be configured for a UE, such as the first wireless device 331 and the second wireless device 332, e.g., in a carrier aggregation system where a UE may have one Primary Cell (PCell) and one or more Secondary Cells (SCells).
- the cell 320 may also be a virtual cell, e.g., characterized by a cell ID but not provide a full cell-like service, associated with a transmit node.
- the signaling described herein may be either via direct links or logical links, e.g., via higher layer protocols and/or via one or more network and/or radio nodes.
- signaling from a coordinating node to a UE, such as the first wireless device 331 and the second wireless device 332, may also pass another network node such as the network node 310, e.g., a radio network node.
- subframe used in the embodiments described herein, typically related to LTE, is an example resource in the time domain, and in general it may be any predefined time instance or time period.
- Measuring node can be a radio node that performs radio measurements of interest transmitted from other radio nodes such as wireless devices, such as the first wireless device 331 and the second wireless device 332, eNodeBs, such as the network node 310, LMUs, etc.
- the measuring node can be a wireless device, such as the first wireless device 331 and the second wireless device 332, or a radio network node, such as the network node 310.
- An image object may comprise, e.g., image data of important landmarks and scenic spots at various geographic positions, image of a street, image of a street marker or of a place name, image of a building, a graphical or visualization object describing or illustrating at least some visual properties of a real object, e.g., a building, a window, a bus stop, a direction sign, or environment, e.g., mountain, an image comprising one or more feature points of the environment, a visualization object, etc.
- An image object may further comprise an encoded or digitally represented image data, e.g., an image data file.
- the image data may comprise a static picture or a moving picture.
- image data formats include: raster, vector, compound, e.g., both pixel and vector data, possible other data, e.g., the interactive features of PDF; EPS, PS, XMAL, PICT, SWF, etc., and stereo, e.g., MPO, PNS, JPS, etc. formats, which may also be in uncompressed or compressed formats. That is, an image data object may be understood as a distinguishable part, i.e., representing/illustrating a physical object, of an image, e.g., a building, a bridge, a tree, etc. Image data may be understood as a data set encoding or describing an image.
- Image recognition may be described as a function of image processing and/or image analysis. It may be implemented in a device, such as the first wireless device 331 and the second wireless device 332, node, such as the network node 310 or any of the first wireless device 331 and the second wireless device 332, or a computer vision system which may or may not be comprised in a wireless communications network, such as the radio communications network 300.
- image recognition may comprise also any one or more of: determination of an object or a pattern comprised in the image data, pattern recognition, object recognition, object identification, object separation, object detection, classification or categorization of a detected object, comparing a determined object or pattern to a reference object or pattern, comparing different views of the same object, etc.
- the first wireless device 331 operates in the radio communications network 300, as described earlier.
- the method is performed by at least one of: the network node 310, the first wireless device 331 , a camera device, the second wireless device 332, an image processing node and a server, each operating in the radio communications network 300.
- the method may comprise the following actions, which actions may as well be carried out in another suitable order than that described below. In some embodiments, all the actions may be carried out, whereas in other embodiments only some action/s may be carried out. Dashed lines of some boxes in Figure 4 indicate that the action is optional.
- the method may comprise signaling capability data associated with image-based positioning to another node 310, 331 , 332, 350 operating in the radio communications network 300. That is, if the method is performed by the first wireless device 331 , the first wireless device 331 may signal the capability to, for example, the network node 310. If, for example, the method is performed by the network node 310, the network node 310 may signal the capability to, for example, the positioning node 350, and so forth. This may be implemented, for example, by sending a message to the another node 310, 331 , 332, 350.
- the method may comprise receiving assistance data for obtaining the image data, from a node 310, 331 , 332, 350 operating in the radio communications network 300. That is, if the method is performed by the first wireless device 331 , the first wireless device 331 may receive the assistance data from, for example, the network node 310. If, for example, the method is performed by the network node 310, the network node 310 may receive the assistance data from, for example, the positioning node 350, and so forth.
- the method may comprise obtaining a positioning Quality of Service for image-based positioning.
- a target, or desired, QoS may be comprised in a positioning request, e.g., received by the wireless device 331 , 332 from the positioning node 350.
- the method comprises obtaining the image data comprising at least two image objects and an angle between lines formed between each of the objects and a reference point.
- the two image objects are comprised in two different images or different image sets.
- the method comprises extracting the at least two image objects from the obtained image data.
- the method comprises determining, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the method comprises using the at least two image objects and/or the image data for positioning the first wireless device 331 based on the determined angle.
- using the at least two image objects and/or the image data comprises processing the image data.
- using the at least two image objects and/or the image data comprises signaling the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point to another node 310, 331 , 332, 350 operating in the radio communications network 300 for positioning.
- the another node 310, 331 , 332, 350 may be the same another node as in action 401 , or a different another node 310, 331 , 332, 350. This action is described below in further detail, for example, under the subheading "1.2 Approach 1 , Step 2 - Using Images Objects for Positioning" and "3.4 Image Data Reporting". Action 407c
- using the at least two image objects and/or the image data comprises obtaining a positioning result using the image data or results of processing the image data.
- using the at least two image objects and/or the image data further comprises signaling the positioning result based on the at least two image objects and/or the image data to another node 310, 331 , 332, 350 operating in the radio communications network 300. This may be implemented, for example, by sending a message to this another node 310, 331 , 332, 350.
- the another node 310, 331 , 332, 350 may be the same another node as in any of actions 401 , 407b, or it may be a different another node 310, 331 , 332, 350.
- the signaling of the positioning result further comprises signaling the obtained positioning Quality of Service.
- the actual QoS associated with a specific result may be comprised in the message comprising an image-based positioning result, as described later, e.g., sent by the wireless device 331 , 332 to the positioning node 350.
- Example of embodiments of a method performed by the positioning node 350 of using the image data for positioning the first wireless device 331 will now be described with reference to a flowchart depicted in Figure 5.
- the positioning node 350 and the first wireless device 331 operate in the radio communications network 300.
- the method may comprise the following actions, which actions may as well be carried out in another suitable order than that described below. In some embodiments, all 5 the actions may be carried out, whereas in other embodiments only some action/s may be carried out. Dashed lines of some boxes in Figure 5 indicate that the action is optional.
- the positioning node 350 obtains the capability data associated with 10 image-based positioning from one of: the network node 310, the first wireless device 331 , the second wireless device 332, the camera device, the image processing node and the server, each operating in the radio communications network 300.
- the positioning node 350 may send the assistance data to the one of: the network node 310, the first wireless device 331 , the second wireless device 332, the camera device, the image processing node and the server, for obtaining the image data. 20 This action is described below in further detail, for example, under the subheading "3.3 Assistance Data for Obtaining Image Data”.
- the positioning node 350 selects the image-based positioning method based on the obtained capability.
- selecting the image-based positioning method may be based on any one or more of: the obtained capability data, a capability associated with image-based positioning of the positioning node 350 and any involved nodes 310, 331 ,
- a client type a service type, an expected accuracy which may be achieved with the image-based positioning, a target positioning Quality of Service requested in a positioning request, landmark characteristics, an environment, time of the day, a season, an expected complexity, an expected resource consumption, available resources for image-based positioning, an image database completeness, and an availability of other positioning methods and whether any of the methods have already been tried for a Location Services, LCS, target.
- LCS Location Services
- the positioning node 350 obtains the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point from the one of: the network node 310, the first wireless device 10 331 , the second wireless device 332, the camera device, the image processing node and the server, wherein the image data comprises the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the positioning node 350 uses the at least two image objects and/or the image data for positioning the first wireless device 331.
- Using may comprise one or more of the following actions:
- using the at least two image objects and/or the image data comprises processing 505a the image data.
- using the at least two image objects and/or the image data comprises signaling the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point to another 35 node 310, 331 , 332, 350 operating in the radio communications network 300 for positioning.
- the another node 310, 331 , 332, 350 may be the same another node as in action 401 , or a different another node 310, 331 , 332, 350.
- using the at least two image objects and/or the image data comprises obtaining the positioning result using the image data or results of processing the image data.
- using the at least two image objects and/or the image data further comprises signaling the positioning result to another node 310, 331 , 332 operating in the radio communications network 300.
- the another node 310, 331 , 332, 350 may be the same another node as in any of actions 401 , 407b, 505b, or it may be a different another node 310, 331 , 332, 350.
- the signaling of the positioning result further comprises signaling the obtained positioning Quality of Service.
- the actual QoS associated with a specific result may be comprised in a message comprising the image-based positioning result, signaled further by the positioning node 350 to the another node 310, 331 , 332.
- the network node 310 comprises the following arrangement depicted in Figure 6.
- the network node 310 and the first wireless device 331 are configured to operate in the radio communications network 300.
- the network node 310 is configured to obtain the image data comprising the at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the two image objects are comprised in the two different images or the different image sets.
- the network node 310 may be configured to obtain the positioning Quality of Service for image-based positioning.
- the network node 310 is further configured to extract the at least two image objects from the obtained image data.
- the network node 310 is further configured to determine, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the network node 310 is further configured to use the at least two image objects and/or the image data for positioning the first wireless device 331 based on the
- to use the at least two image objects and/or the image data comprises to process the image data.
- to use the at least two image objects and/or the image data comprises to obtain the positioning result using the image data or the results of processing the image data.
- to use the at least two image objects and/or the image data comprises to signal the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point to another node 331 , 332, 350 configured to operate in the radio communications network 300, as described in action 407b, for positioning.
- to use the at least two image objects and/or the image data further comprises to signal the positioning result based on the at least two image objects and/or the image data to another node 331 , 332, 350 configured to operate in the radio communications network 300.
- the network node 310 may be further configured to signal the capability data associated with image-based positioning to another node 331 , 332, 350 configured to operate in the radio communications network 300, as described earlier in action 401.
- to signal the positioning result further comprises to signal the obtained positioning Quality of Service.
- the network node 310 may be further configured to receive the assistance data for obtaining the image data, from the node 310, 331 , 332, 350 configured to operate in the radio communications network 300, as described earlier in action 402.
- the embodiments herein for using the image data for positioning the first wireless device 331 may be implemented through one or more processors, such as the
- the program code mentioned above may also be provided as a computer program product, for instance in the form of a data carrier carrying computer program code for performing the embodiments herein when being loaded into the in the network node 310.
- a data carrier carrying computer program code for performing the embodiments herein when being loaded into the in the network node 310.
- One such carrier may be in the form of a CD ROM disc. It may be however feasible with other data carriers such as a memory stick.
- the computer program code may furthermore be provided as pure program code on a server and downloaded to the network node 310.
- the network node 310 may further comprise a memory module 608 comprising one or more memory units.
- the memory module 608 may be arranged to be used to store data in relation to applications to perform the methods herein when being executed in the network node 310.
- Memory module 608 may be in communication with the processing module 607. Any of the other information processed by the processing module 607 may also be stored in the memory module 608.
- information may be received from, e.g., the first wireless device 331 , the second wireless device 332, or the positioning node 350, through a receiving port 609.
- the receiving port 609 may be, for example, connected to the one or more antennas in the network node 310.
- the network node 310 may receive information from another structure in the radio communications network 300 through the receiving port 609. Since the receiving port 609 may be in communication with the processing module 607, the receiving port 609 may then send the received information to the processing module 607.
- the receiving port 609 may also be configured to receive other information.
- the information processed by the processing module 607 in relation to the embodiments of method herein may be stored in the memory module 608 which, as stated earlier, may be in communication with the processing module 607 and the receiving port 609.
- the processing module 607 may be further configured to transmit or send information to e.g., the first wireless device 331 , the second wireless device 332, or the positioning node 350, through a sending port 610, which may be in communication with the processing module 607, and the memory module 608.
- modules 601-606 5 described above may refer to a combination of analog and digital modules, and/or one or more processors configured with software and/or firmware, e.g., stored in memory, that, when executed by the one or more processors such as the processing module 607, perform as described above.
- SoC system-on-a- chip
- the computer program product may be stored on a computer-readable storage medium.
- the computer-readable storage medium having 20 stored thereon the computer program, may comprise instructions which, when executed on at least one processor, cause the at least one processor to carry out the actions described herein, as performed by the network node 310.
- the computer-readable storage medium may be a non-transitory computer-readable storage medium.
- the different modules 601-606 described above may refer to respective applications running on one or more processors.
- the first wireless device 331 comprises the following arrangement depicted in Figure 7.
- the wireless device 331 , 332 and the first wireless device 331 are configured to operate in the radio communications network 300.
- the wireless device 331 , 332 is configured to obtain the image data comprising the 5 at least two image objects and the angle between the lines formed between each of the objects and the reference point.
- the two image objects are comprised in the two different 10 images or the different image sets.
- the wireless device 331 , 332 may be configured to obtain the positioning Quality of Service for image-based positioning.
- the wireless device 331 , 332 is further configured to extract the at least two image objects from the obtained image data.
- the wireless device 331 , 332 is further configured to determine, from the obtained image data, the angle between the lines formed between each of the objects and the reference point.
- the wireless device 331 , 332 is further configured to use the at least two image objects and/or the image data for positioning the first wireless device 331 based on the determined angle.
- to use the at least two image objects and/or the image data comprises to process the image data.
- to use the at least two image objects and/or the image data comprises to obtain the positioning result using the image data or results of processing 35 the image data. In some embodiments, to use the at least two image objects and/or the image data further comprises to signal the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point to another node 331 , 332, 350 configured to operate in the radio communications network 5 300, as described in action 407b, for positioning.
- to use the at least two image objects and/or the image data further comprises to signal the positioning result based on the at least two image objects and/or the image data to another node 331 , 332, 350 configured to operate in the radio communications network 300.
- the wireless device 331 , 332 may be further configured to signal the capability data associated with image-based positioning to another node 331 , 332, 350 configured to operate in the radio communications network 300, as described earlier in action 401.
- This may be performed by a signaling module 705 comprised in the wireless
- to signal the positioning result further comprises to signal the obtained positioning Quality of Service.
- the wireless device 331 , 332 may be further configured to receive the assistance data for obtaining the image data, from the node 310, 331 , 332, 350 configured to operate in the radio communications network 300, as described earlier in action 402.
- This may be performed by a receiving module 706 comprised in the wireless
- the embodiments herein for using image data for positioning the first wireless device 331 may be implemented through one or more processors, such as the
- the program code mentioned above may also be provided as a computer program product, for instance in the form of a data carrier carrying computer program code for performing the embodiments herein when being loaded into the in the wireless device
- the computer program code may furthermore be provided as pure program code on a server and downloaded to the wireless device 331 , 332.
- the wireless device 331 , 332 may further comprise a memory module 708
- the memory module 708 may be arranged to be used to store data in relation to applications to perform the methods herein when being executed in the wireless device 331 , 332.
- Memory module 708 may be in communication with the processing module 707. Any of the other information processed by the processing module 707 may also be stored in the memory module 708.
- information may be received from, e.g., the network node 310, the first wireless device 331 , the second wireless device 332, or the positioning node 350, through a receiving port 709.
- the receiving port 709 may be, for example, connected to the one or more antennas in the wireless device 331 , 332.
- the wireless device 331 , 332 may receive information from another structure in the radio communications network 300 through the receiving port 709. Since the receiving port 709 may be in communication with the processing module 707, the receiving port 709 may then send the received information to the processing module 707.
- the receiving port 709 may also be configured to receive other information.
- the information processed by the processing module 707 in relation to the embodiments of method herein may be stored in the memory module 708 which, as stated earlier, may be in communication with the processing module 707 and the receiving port 709.
- the processing module 707 may be further configured to transmit or send information to e.g., the network node 310, the first wireless device 331 , the second wireless device 332, or the positioning node 350, through a sending port 710, which may be in communication with the processing module 707, and the memory module 708.
- modules 701-706 described above may refer to a combination of analog and digital modules, and/or one or more processors configured with software and/or firmware, e.g., stored in memory, that, when executed by the one or more processors such as the processing module 707, perform as described above.
- processors as well as the other digital hardware, may be included in a single application-specific integrated circuit (ASIC), or several processors and various digital hardware may be distributed among several separate components, whether individually packaged or assembled into a system-on-a- chip (SoC).
- ASIC application-specific integrated circuit
- SoC system-on-a- chip
- the methods according to the embodiments described herein for the wireless device 331 , 332 are respectively implemented by means of a computer program product, comprising instructions, i.e., software code portions, which, when executed on at least one processor, cause the at least one processor to carry out the actions described herein, as performed by the wireless device 331 , 332.
- the computer program product may be stored on a computer-readable storage medium.
- the computer-readable storage medium, having stored thereon the computer program may comprise instructions which, when executed on at least one processor, cause the at least one processor to carry out the actions described herein, as performed by the wireless device 331 , 332.
- the computer-readable storage medium may be a non-transitory computer- readable storage medium.
- the different modules 701-706 described above may refer to respective applications running on one or more processors.
- the positioning node 350 comprises the following arrangement depicted in Figure 8.
- the positioning node 350 and the first wireless device 331 are configured to operate in the radio communications network 300.
- the positioning node 350 is configured to obtain the capability data associated with image-based positioning from one of: the network node 310, the first wireless device 331 , the second wireless device 332, the camera device, an image processing node and a server, each configured to operate in the radio communications network 300. This may be performed by an obtaining module 801 comprised in the positioning node 350.
- the positioning node 350 is further configured to obtain the image data and/or the at least two image objects and the angle between the lines formed between each of the objects and the reference point from the one of: the network node 310, the first wireless device 331 , the second wireless device 332, the camera device, the image processing node and the server, wherein the image data comprises the at least two image objects and the angle between lines formed between each of the objects and the reference point.
- the positioning node 350 is further configured to select the image-based positioning method based on the obtained capability.
- to select the image-based positioning method is based on any one or more of: the obtained capability data, a capability associated with image-based positioning of the positioning node 350 and any involved nodes 310, 331 , 332, a client type, a service type, an expected accuracy which may be achieved with the image-based positioning, a target positioning QoS requested in a positioning request, landmark characteristics, an environment, time of the day, a season, an expected complexity, an expected resource consumption, available resources for image-based positioning, an image database completeness, and an availability of other positioning methods and whether any of the methods have already been tried for a Location Services, LCS, target.
- LCS Location Services
- the positioning node 350 is further configured to use the at least two image objects and/or the image data for positioning the first wireless device 331.
- to use the at least two image objects and/or the image data comprises to process the image data.
- to use the at least two image objects and/or the image data comprises to obtain the positioning result using the image data or results of processing the image data. In some embodiments, to use the at least two image objects and/or the image data comprises to signal the positioning result to another node 310, 331 , 332 configured to operate in the radio communications network 300, as described in action 505d.
- to signal the positioning result further comprises to signal the obtained positioning QoS.
- the positioning node 350 may be further configured to send the assistance data to the one of: the network node 310, the first wireless device 331 , the second wireless device 332, the camera device, the image processing node and the server, for obtaining the image data.
- the embodiments herein using the image data for positioning the first wireless device 331 may be implemented through one or more processors, such as the
- the program code mentioned above may also be provided as a computer program product, for instance in the form of a data carrier carrying computer program code for performing the embodiments herein when being loaded into the in the positioning node 350.
- a data carrier carrying computer program code for performing the embodiments herein when being loaded into the in the positioning node 350.
- One such carrier may be in the form of a CD ROM disc. It may be however feasible with other data carriers such as a memory stick.
- the computer program code may furthermore be provided as pure program code on a server and downloaded to the positioning node 350.
- the positioning node 350 may further comprise a memory module 806 comprising one or more memory units.
- the memory module 806 may be arranged to be used to store data in relation to applications to perform the methods herein when being executed in the positioning node 350.
- Memory module 808 may be in communication with the processing module 805. Any of the other information processed by the processing module 805 may also be stored in the memory module 806.
- information may be received from, e.g., the network node 310 or the first wireless device 331 , through a receiving port 807.
- information may be received from, e.g., the network node 310 or the first wireless device 331 , through a receiving port 807.
- the receiving port 807 may be, for example, connected to the one or more antennas in the positioning node 350.
- the positioning node 350 may receive information from another structure in the radio communications network 300 through the receiving port 807. Since the receiving port 807 may be in communication with the processing module 805, the receiving port 807 may then send the received information to the processing module 805.
- the receiving port 807 may also be configured to receive other information.
- the information processed by the processing module 805 in relation to the embodiments of method herein may be stored in the memory module 806 which, as stated earlier, may be in communication with the processing module 805 and the receiving port 807.
- the processing module 805 may be further configured to transmit or send information to e.g., the network node 310 or the first wireless device 331 , through a sending port 808, which may be in communication with the processing module 805, and the memory module 806.
- modules 801-804 described above may refer to a combination of analog and digital modules, and/or one or more processors configured with software and/or firmware, e.g., stored in memory, that, when executed by the one or more processors such as the processing module 805, perform as described above.
- processors as well as the other digital hardware, may be included in a single application-specific integrated circuit (ASIC), or several processors and various digital hardware may be distributed among several separate components, whether individually packaged or assembled into a system-on-a- chip (SoC).
- ASIC application-specific integrated circuit
- SoC system-on-a- chip
- the methods according to the embodiments described herein for the positioning node 350 are respectively implemented by means of a computer program product, comprising instructions, i.e., software code portions, which, when executed on at least one processor, cause the at least one processor to carry out the actions described herein, as performed by the positioning node 350.
- the computer program product may be stored on a computer-readable storage medium.
- the computer-readable storage medium, having stored thereon the computer program may comprise instructions which, when executed on at least one processor, cause the at least one processor to carry out the actions described herein, as performed by the positioning node 350.
- the computer-readable storage medium may be a non-transitory computer- readable storage medium.
- the different modules 801-804 described above may refer to respective applications running on one or more processors.
- the method to use image data for positioning may include:
- Step 1 obtaining the at least two image objects and the angle between the lines formed between each of the objects and the reference point;
- Step 2 using the at least two image objects/data for positioning a wireless
- the device such as the first wireless device 331.
- the image objects may be as described above.
- the image data may also include additional data, such as any one or more of:
- Image data characteristics e.g., size, quality color, etc.
- Camera characteristics e.g., type, capability, configuration, etc.
- Radio measurements e.g., cell ID, signal strength, a timing measurement, etc.
- Environment indication e.g., indoor/outdoor determined based on a sensor
- Time of taking the picture e.g., time of the day, day of the week, month, season, year;
- Location information if available, e.g., GPS location of the reference point or the last known location of the wireless device, area indication such as a tracking area ID, a local area ID, a cell ID, etc.
- the reference point may include, among others, a location from where the image was taken with a camera.
- the angle may be pre-defined or may be determined by the type of the device, e.g., the first wireless device 331 or the second wireless device 332, taking the images.
- the angle may be configurable or acquired, from configuration data, database, device, etc...
- the angle information may be obtained together with or in relation to the at least two image objects, may be determined based on a pre-defined rule or acquired from a database.
- the angle of each image may be with respect to a pre-defined direction, e.g., with respect to geographical North, so it may be straightforward to determine the angle between the two pictures too.
- the direction determining the angle may be with respect to a certain location comprised in the image, e.g., a center point.
- the angle e.g., direction towards a sight or a geographical object, may also be the corresponding camera direction.
- the angle may be horizontal, vertical, or both.
- the angle may be absolute or relative.
- the above steps may be implemented in a device, such as the first wireless device 331 or the second wireless device 332, or a network node, such as the network node 310, and may involve one or more nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350.
- the step of obtaining the image objects may comprise any one or more of:
- the user may be taking pictures for other purposes;
- Extracting two or more image objects from a wider-view pictures For example, a pair of image objects at a certain angle with respect to a reference point may be extracted from a panoramic view picture;
- the step of obtaining the image object may be performed:
- Step 1 may be implemented in:
- a device e.g., the first wireless device 331 , the second wireless device 332, a camera taking pictures upon a request, e.g., from an application or from another node, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, which may be a wireless device itself, may be comprised in a wireless device, or may be able to communication with a wireless device or another node;
- a wireless device such as the first wireless device 331 or the second wireless device 332;
- a radio network node such as the network node 310, e.g., eNodeB;
- an image processing function or node e.g., device/node capable of image
- Figure 9a illustrates an example of a device when two pairs of images, e.g., pictures, pair A,C and pair B,D were obtained from the same location.
- Pictures A, C, B and D are shown in Figure 9b.
- Each pair comprises two images in the strictly opposite directions with respect to the device, e.g., the first wireless device 331 , i.e., the device is on a line connecting the locations illustrated in the two corresponding pictures, e.g., connecting the center points of the locations in the pictures, and the camera has been rotated to obtain the second pair.
- a particular advantage of taking pictures in the opposite directions may be that it is known that the camera is located exactly between the two locations illustrated in the pictures. Having two such pairs of the pictures taken from the same location may uniquely identify the device location, see Figures 10a and 10b, which are described further down. This may reduce or avoid the need for knowing the zoom factor, camera focus, characteristics of the camera lens, and possible image
- Using the image objects for positioning may include any one or more of:
- the database may comprise and/or be associated with radio
- Radio Frequency (RF) fingerprints e.g., a database for AECID, RF pattern matching, etc.;
- the obtained image data may be stored together with the location information, including:
- ⁇ location information obtained based on these image data e.g., the positioning result.
- search - classifying may also be based on other data associated with/comprised in the image data, such as time, cell ID(s), radio measurements, etc.;
- o Matching e.g., comparing and/or finding similarity, the image objects comprised in the image data to the one or more candidate image objects; o Recognizing one or more objects, e.g., signs, buildings, etc., comprised in the image data, i.e., based on pattern recognition or image recognition; Using the image data or results of processing the image data to obtain a positioning result:
- a positioning result represented by any of a pre-defined shape e.g., a Geographical Area Description (GAD) shape defined in 3GPP TS 23.032 V1 1.0.0 "Universal Geographical Area Description (GAD)" o See Embodiment herein 2 for more details and examples
- Embodiment herein 2 Position Estimation Based On At Least Two Images
- a non-limiting example of positioning method for obtaining a positioning result based on at least two image objects is described. Note that the method may be extended for the use in hybrid positioning, e.g., combining image data with other measurements, e.g., timing measurements such as timing advance or Round-Trip Time (RTT), received signal strength or quality, AoA measurements, etc..
- timing measurements such as timing advance or Round-Trip Time (RTT), received signal strength or quality, AoA measurements, etc.
- the image data may be used together, simultaneously or in any sequence, with at least one radio measurement, CID may be considered as a radio measurement, to obtain a position and/or image data may be signaled together with at least one radio measurement and/or the image data may be stored together with at least one radio measurement in a database used for positioning.
- CID may be considered as a radio measurement
- the embodiments described herein may be also combined with embodiments described in Embodiment herein 1.
- FIGS 10a and 10b illustrate examples of two Dimensional (2D) and three
- Figure 10a illustrates an example of finding a 2D position of the device, e.g., the first wireless device 331 , the position of which is represented in the figure by the circle in the intersection of the lines, with uncertainty equal to the circle radius.
- the two horizontal lines between reference objects are represented with continuous lines because in this case, their position is known.
- Figure 10b illustrates an example of finding a 3D position of the device, e.g., the first wireless device 331 , e.g., a vertical dashed line.
- the vertical bold dashed line marks the intersection line of the vertical planes between the pair of images A,C and B,D, in the figure.
- the position of the device e.g., the first wireless device 331
- the two horizontal lines between reference objects are represented with continuous lines because in this case, their position is known.
- the position of the device e.g., the first wireless device 331 is derived from the intersection of the lines.
- Figure 11 illustrates an example of finding a 3D position of the device when the vertical angles, that is, the angles between e.g., the line AC and the strictly vertical line, i.e., a normal, e.g., a line perpendicular to e.g. the earth surface, are unknown. That is, the two horizontal lines between the reference objects are known to be somewhere within the corresponding vertical plane. Since their position is not entirely known, they are represented in the figure as dashed lines. Thus, the position of the device, e.g., the first wireless device 331 is derived from the intersection of the planes. In the figure, the vertical bold dashed line marks the intersection line of the vertical planes, containing the lines AC and BD, respectively, between the pair of images A,C and B,D, in the figure, Plane 1 and Plane 2, respectively.
- the vertical bold dashed line marks the intersection line of the vertical planes, containing the lines AC and BD, respectively, between the pair of images A,C and B,D, in
- other positioning methods e.g., pattern matching
- the body impact may comprise the additional path loss in the radio signal path due to the human body, e.g., when holding a mobile in a hand against the head.
- the vertical angle of the camera may be less important, since, as clarified in Figures 10a and 10b, the imaginary lines may be in either way comprised in the same vertical plane, and it is the intersection of the two planes which may justify the way of obtaining the 3D result in Figure 10b, i.e., obtain first the horizontal location, and then assume that the device, e.g., the first wireless device 331 , is located on a line perpendicular to the horizontal surface.
- a more accurate 3D location may be further determined, e.g., based on analyzing the image objects angles or using hybrid positioning, see e.g., Figures 12-13.
- Figure 12 illustrates an example of hybrid positioning based on two pictures, i.e., A and C, taken at a 180° angle, and a timing and/or distance measurement with respect to a serving eNB, e.g., the network node 310 of the wireless device, e.g., the wireless device 331 , being located.
- the timing and/or distance measurement forms an intersecting arc, represented by the continuous curved line in the figure.
- a wireless device M such as the first wireless device 331
- a distance to a fixed point N such as the network node 310
- the possible locations of M lie on a circle around N with a radius equal to the distance; the circle may further be limited to a part of it, i.e., an arc, when some more information, even though not exact location of M, about the direction of M with respect to N is available.
- the location of the horizontal lines between the reference objects is not known, and it is therefore represented as a dashed line.
- the serving eNB e.g., the network node 310, which communicates with the first wireless device 330 via the first radio link 341 , is represented in this figure.
- Figure 13 illustrates an example of finding a 3D position, e.g., small circle, of the device, e.g., the first wireless device 331 , using hybrid positioning, e.g., with timing and/or distance measurement.
- the vertical bold dashed line marks the vertical line from the intersection point of the two horizontal lines.
- the circle represents the location of the device, e.g., the first wireless device 331.
- the continuous curved line represents a timing and/or distance measurement, forming an intersecting arc.
- the serving eNB e.g., the network node 310, which communicates with the first wireless device 330 via the first radio link 341 , is represented in this figure.
- Embodiment herein 3 Signaling and Procedural Enhancements to Support Image-Based Positioning
- the image-based positioning method may comprise any one or any combination of:
- Embodiment herein 1 or determining movement characteristics, e.g., movement direction, speed, vehicle type, of a target wireless device, e.g., the first wireless device 331 , based at least on one or more of image data sets obtained at the target device's, e.g., the first wireless device 331 , location towards other objects, see e.g., Figures 9a and 9b;
- Method 2 Obtaining a positioning result, see e.g., "positioning result" in the
- an object location may be determined by comparing a picture with the object with a picture without the object, wherein the picture illustrates a known area, so that the object location may be determined based on the location of the object in the picture;
- Method 3 Obtaining a subset of pre-defined image sets, e.g., the indicators
- the pre-defined image sets may be obtained in different ways, e.g., acquired from a database or provided in the assistance data - see also a separate section on the assistance data.
- An advantage of this method may be that it does not require a camera.
- a positioning node e.g., the positioning node 350, may support a range of positioning methods, e.g., any one or more of: GPS, GNSS, A-GNSS, OTDOA, UTDOA, E-CID, pattern matching, AECID, etc. so image, or image recognition, based positioning may comprise a separate positioning method. As described in other approaches, it may also be comprised in a hybrid positioning method. Selection of the image-based positioning may be based e.g., on any one or more of:
- the positioning node e.g., the positioning node 350
- the involved nodes e.g., the nodes that may be expected to provide the image data, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350;
- Client Type e.g., a new Client Type may be introduced which may be associated with image-based positioning; the Client Type may be typically received by the positioning node, e.g., the positioning node 350, from another node, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, or from the LCS Client in i.e., the positioning node 350, together with a positioning request or prior selecting a positioning method;
- Service Type e.g., a new Service Type may be introduced in the standard or configured by an operator which may be associated with image-based positioning; the Service Type, e.g., emergency or commercial application is typically received by the positioning node, e.g., the positioning node 350, from another node, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, or from the LCS Client in i.e., the positioning node 350, together with a positioning request or prior selecting a positioning method;
- the positioning node e.g., the positioning node 350
- the positioning node may know approximately the area of the device, e.g., the first wireless device 331 , and the success probability of the image-based positioning
- time of the day e.g., image-based positioning may be challenging outdoors during a night, season;
- image-based positioning may be selected to obtain image data for further calculation of the location for the same device, e.g., the first wireless device 331.
- image-based positioning may be selected to obtain image data in conjunction with a high-accuracy positioning method, e.g., GPS, GNSS, A-GNSS, OTDOA, etc., for collecting the image data together with the known location and using the collected image data for positioning of other devices, such as the second wireless device 332.
- a high-accuracy positioning method e.g., GPS, GNSS, A-GNSS, OTDOA, etc.
- capability data associated with image-based positioning may be communicated between two nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350:
- a wireless device such as any of the first wireless device 331 or the second wireless device 332, is a special case of a device; in one example, at least one of the devices may be a wireless device, such as any of the first wireless device 331 or the second wireless device 332, - e.g., via device-to-device communication interface(s), machine-to-machine
- radio network node such as the network node 310
- another network node not equipped with a radio interface e.g., positioning node, such as the positioning node 350, SLP, MME, O&M, SON node, MDT node;
- a wireless device such as any of the first wireless device 331 or the second wireless device 332, to a network node not equipped with a radio interface, e.g., to a positioning node, such as the positioning node 350, SLP, etc. - e.g., via LPP or
- the capability data associated with image-based positioning may comprise, e.g., one or more of:
- the capability data may also comprise such additional data as, e.g., any one or any combination of the below:
- Image data types e.g., file formats
- Color schemes e.g., black and white, basic color set, extended color set, etc., or color coding
- Maximum image data size e.g., up to 1 MegaByte (MB), 2 MB, 5 MB, or more, e.g., per image data set or in total for several image data sets;
- the capability data may also be comprised in a specific node type, category, or a pre-defined configuration. Hence signaling of this information, type, category, configuration indicator, etc., may comprise also signaling of the capability data.
- the node obtaining the capability may use it, e.g., for:
- Allocate resources e.g., message size or transport block size, transmission
- a node such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, or a function within the node, may provide assistance data or a request to another node, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, or a function within the same node, to assist obtaining the image data for positioning purpose.
- the assistance data may be provided in response to the obtained capability data.
- the assistance data/request may comprise, e.g., recommend or request, e.g., any one or more of:
- Image data size e.g., based on the radio link capacity or image recognition
- the assistance data may comprise, a set of reference image data sets.
- the user may select one or more image data sets according to a rule, e.g., select pictures with the sights closest to the user location or form two opposite sides, e.g., front and back; left and right.
- the assistance data may comprise also one or more rules and/or instructions to the user.
- the assistance data may comprise, one or more references to pre-defined image data sets, stored in a local database, a database retrieved from another device or node, etc... The reference may be selected based on the cell ID of the cell where a wireless device, e.g., the first wireless device 331 , is located.
- a node such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, or a function within the node, may provide the image data to another node, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, for the purpose of positioning or to another function within the same node for the purpose of positioning.
- the involved nodes and interfaces may be similar to those described for capability exchange.
- the image may be provided by a device to a positioning server or another device, e.g., any of the first wireless device 331 or the second wireless device 332.
- the image data may be an image file. In another example, it may also be one or more references to pre-defined image data sets, selected from a database, from the received assistance data, etc.
- the image reporting may be upon a request, upon availability, periodic, or event- triggered, e.g., upon a delivery of the image data to an application layer, etc.
- the image data may also comprise additional data or assistance data for image processing may include among others any one or more of:
- ⁇ Environment type e.g., indoor or outdoor; light characteristics, etc. - e.g.,
- the same sensors may be used when taking a picture and when determining environment type.
- the above additional information may be obtained with sensors and/or by acquiring from a stored configuration associated with the image data and may be used e.g., for configuring or optimizing image processing or image recognition, e.g., time of the day determines also type of light.
- the image data may also be provided together with at least one radio measurement.
- positioning QoS information, uncertainty, confidence, etc. may be provided together with a prior-art positioning result such as the result obtained with GPS, OTDOA, etc..
- Obtaining a positioning result QoS for image-based positioning is described herein.
- one or more of QoS characteristics may be obtained and/or included in a positioning result obtained based on image-based positioning.
- Horizontal uncertainty, vertical uncertainty, and a confidence level are some examples of QoS characteristics.
- the QoS characteristics may be included in a positioning result, e.g., when described by a predefined shape, e.g., a GAD shape as described in 3GPP TS 23.032 V1 1.0.0
- the QoS characteristics may be obtained as a function of and/or based on any one or more of:
- a device e.g., the first wireless device 331
- location e.g., size of the area captured in the picture - the larger size the larger uncertainty is
- Zoom factor e.g., no zoom or small zoom may be associated with a smaller
- Quality/accuracy of the image recognition e.g., may be associated with processing time - longer processing gives more accurate result
- Figure 14 illustrates Figure 10a with the uncertainty taken into account.
- the uncertainty level is represented in the width of the each of the strips, represented by the continuous lines between A and C, and B and D, which in turn depends e.g., on the area size of captured in the pictures A, B, C, D, see Figures 9a and 9b.
- Figure 14 illustrates an example of finding a 2D position of the device, e.g., the first wireless device 331.
- the location of the device, e.g., first wireless device 331 is represented in the figure as a circle, with the uncertainty of the location being equal to the circle radius.
- An uncertainty polygon is represented in bold - the intersection of the two strips.
- the dashed lines represent lines between reference objects bound from both sides by lines corresponding to the uncertainty of the dashed lines.
- the methods described herein may be implemented statically, semi-statically or dynamically. In each case, they may be implemented in a radio node, such as the network node 310, a wireless device, such as the wireless device 331 , 332, a device, radio network node, such as the network node 310, a network node, such as the network node 310, a positioning node, such as the positioning node 350, a measuring node, and a coordinating node, among others.
- the nodes need not be separate. That is, a single apparatus may be configured to perform functions of multiple nodes.
- an example network node 310 may include a controller, a communicator, a positioning node selector, and a share info learner.
- the communicator may be configured to perform wired and/or wireless
- the positioning node selector may be configured to select a positioning node 350, as described above.
- the share info learner may be configured to learn any one or more of the sharing capability, capacity, and configuration of one or more measuring nodes and devices, such as the first wireless device 331 or the second wireless device 332.
- the controller may be configured to control the overall operation of the network node 310.
- Figure 15 provides an example logical view of the network node 310 and the circuits, which may alternatively be denoted modules, devices or units, included therein. It is not strictly necessary that each circuit be implemented as physically separate modules. Some or all circuits may be combined in a physical module.
- the circuits of the network node 310 need not be implemented strictly in hardware. It is envisioned that the circuits may be implemented through any combination of hardware and software.
- the network node 310 may include a processor, a storage, internal, external, or both, and one or both of a wireless interface, e.g., in case of a radio node, and a network interface, in case of a radio network node or a core network node.
- the processor may be configured to execute program instructions to perform the functions of one or more of the network node circuits.
- the instructions may be stored in a non-transitory storage medium or in firmware, e.g., Read-Only Memory (ROM), Random-Access Memory (RAM), Flash, denoted as storage.
- the program instructions may also be received through wired and/or or wireless transitory medium via one or both of the wireless and network interfaces.
- the wireless interface e.g., a transceiver, may be configured to receive signals from and send signals to other radio nodes via one or more antennas.
- Not all network nodes 310 may be equipped with a radio interface and radio antennas, e.g., core network nodes.
- the network interface may be included and configured to communicate with other radio and/or core network nodes.
- an example positioning node 350 may include a controller, a communicator, an assistance data provider, an image obtainer, a positioning method selector, and a device positioner.
- Figure 17 provides a logical view of the positioning node 350 and the circuits included therein. It is not strictly necessary that each circuit be implemented as physically separate modules. Some or all circuits may be combined in a physical module. The circuits of the positioning node 350 need not be implemented strictly in hardware. It is envisioned that the positioning node 350 circuits can be implemented through any combination of hardware and software.
- the positioning node 350 may include a processor, a storage, and one or both of a wireless interface and a network interface.
- the processor may be configured to execute program instructions to perform the functions of one or more of the positioning node 350 circuits.
- the instructions may be stored in a non-transitory storage medium or in firmware.
- the program instructions may also be received through wired and/or or wireless transitory medium via one or both of the wireless and network interfaces.
- the wireless interface may be configured to receive signals from and send signals to other radio nodes, such as the network node 310, via one or more antennas. Not all positioning nodes may be equipped with a radio interface and radio antennas.
- core network nodes may serve as positioning nodes 350, e.g., E-SMLC, SLP.
- the network interface may be configured to communicate with other radio and/or core network nodes.
- an example measuring node may include a controller, a communicator, a signal receiver, a positioning parameter measurer, and a share info provider.
- the communicator may be configured to perform wired and/or wireless
- the signal receiver may be configured to receive one or more signals, e.g., SRS, from which positioning
- the positioning parameter measurer may be configured to perform measurements of one or more positioning parameters, e.g., image-based, timing- based, power-based, hybrid, of the received signals.
- the share info provider may be configured to provide any one or more of the measuring node's sharing capability, capacity, and configuration to one or more other nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, and/or wireless devices, such as any of the first wireless device 331 or the second wireless device 332.
- the controller may be configured to control the overall operation of the measuring node.
- Figure 19 provides a logical view of the measuring node and the circuits included therein. It is not strictly necessary that each device be implemented as physically separate modules. Some or all devices may be combined in a physical module.
- the devices of the measuring node can be implemented through any combination of hardware and software.
- the measuring node may include a processor, a storage, a wireless interface, and a network interface.
- the processor may be configured to execute program instructions to perform the functions of one or more of the measuring node circuits.
- the instructions may be stored in a non-transitory storage medium or in firmware.
- the instructions may also be received through wired and/or or wireless transitory medium via one or both of the wireless and network interfaces.
- the wireless interface may be configured to receive signals from and send signals to other radio nodes via one or more antennas.
- the network interface may be configured to communicate with other radio nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, and/or core network nodes.
- an example coordinating node may include a controller, a communicator, a prioritizer, a measuring node selector, and an association determiner.
- the communicator may be configured to perform wired and/or wireless communication with other nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, and/or devices, such as any of the first wireless device 331 or the second wireless device 332, using any of the protocols as described above.
- the prioritizer may be configured to prioritize among the positioning nodes 350 and measuring nodes.
- the measuring node selector may be configured to select a set of measuring nodes.
- the association determiner may associate and/or determine associations among the measuring nodes and the positioning nodes 350.
- the controller may be configured to control the overall operation of the coordinating node.
- Figure 21 provides a logical view of the coordinating node and the devices included therein. It is not strictly necessary that each device be implemented as physically separate modules. Some or all devices may be combined in a physical module.
- the circuits of the coordinating node can be implemented through any combination of hardware and software.
- the coordinating node may include a processor, a storage, a wireless interface, and a network interface.
- the processor may be configured to execute program instructions to perform the functions of one or more of the coordinating node devices.
- the instructions may be stored in a non- transitory storage medium or in firmware.
- the instructions may also be received through wired and/or or wireless transitory medium via one or both of the wireless and network interfaces.
- the wireless interface may be configured to receive signals from and send signals to other radio nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, via one or more antennas. Not all coordinating nodes may be equipped with a radio interface and radio antennas, e.g., O&M node, P-GW, SON node, etc...
- the network interface may be configured to communicate with other radio nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, and/or core network nodes.
- an example wireless device 331 , 332 may include a controller, a communicator, a measurement signal generator, and an assistance provider/receiver.
- the communicator may be configured to perform wireless communication with other radio nodes, such as any of the network node 310, the first wireless device 331 , the second wireless device 332, and the positioning node 350, and/or wireless devices, such as any of the first wireless device 331 or the second wireless device 332, using one or more of the protocols as described above.
- the measurement signal generator may be configured to generate signals used for measurement, e.g., SRS. Note that data signals may also be used for measurements.
- the assistance provider may be configured to provide assistance to any one or more of the network 310, positioning 350, measuring, and coordinating nodes for position measurement purposes. Note that for DL positioning, the wireless device 331 , 332 may receive assistance data provided by a network node 310.
- Figure 23 provides a logical view of the wireless device 331 , 332 and the circuits included therein. It is not strictly necessary that each device be implemented as physically separate modules. Some or all circuits may be combined in a physical module.
- the wireless device 331 , 332 may be implemented through any combination of hardware and software.
- the wireless device 331 , 332 may include a processor, a storage, and a wireless interface.
- the processor may be configured to execute program instructions to perform the functions of one or more of the coordinating node devices.
- the instructions may be stored in a non-transitory storage medium or in firmware.
- the instructions may also be received through a wireless transitory medium via the wireless interface.
- the wireless interface may be configured to receive signals from and send signals to other radio nodes via one or more antennas.
- Avoid performing radio measurements and the power of the wireless device 331 , 332 may be saved, e.g., if another device, such as any of the first wireless device 331 or the second wireless device 332, is used to take images and communicate then the images to the wireless device 331 , 332;
- the modules described may be for performing any of the pertinent embodiments described.
- the embodiments herein are not limited to the above described preferred embodiments. Various alternatives, modifications and equivalents may be used. Therefore, the above embodiments should not be taken as limiting the scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Automation & Control Theory (AREA)
- Multimedia (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
L'invention porte sur un procédé d'utilisation de données d'image pour localiser un premier dispositif sans fil dans un réseau de radiocommunication. Le procédé consiste à obtenir des données d'image comprenant au moins deux objets d'image et un angle entre des lignes formées entre chacun des objets et un point de référence. Le procédé consiste en outre à extraire les au moins deux objets d'image des données d'image obtenues, à déterminer, à partir des données d'image obtenues, l'angle entre les lignes formées entre chacun des objets et le point de référence, et à utiliser les au moins deux objets d'image et/ou les données d'image pour localiser le premier dispositif sans fil sur la base de l'angle déterminé. Le procédé est mis en œuvre par au moins un élément parmi : un nœud de réseau, le premier dispositif sans fil, un dispositif de caméra, un second dispositif sans fil, un nœud de traitement d'image et un serveur, fonctionnant chacun dans le réseau de radiocommunication.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/758,931 US20150339823A1 (en) | 2013-01-09 | 2013-12-27 | Supporting and enhancing image-based positioning |
| EP13826662.2A EP2943804B1 (fr) | 2013-01-09 | 2013-12-27 | Prise en charge et amélioration de localisation à base d'image |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201361750736P | 2013-01-09 | 2013-01-09 | |
| US61/750,736 | 2013-01-09 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2014109694A2 true WO2014109694A2 (fr) | 2014-07-17 |
| WO2014109694A3 WO2014109694A3 (fr) | 2014-09-18 |
Family
ID=50030428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/SE2013/051621 Ceased WO2014109694A2 (fr) | 2013-01-09 | 2013-12-27 | Prise en charge et amélioration de localisation à base d'image |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20150339823A1 (fr) |
| EP (1) | EP2943804B1 (fr) |
| WO (1) | WO2014109694A2 (fr) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104502884A (zh) * | 2014-12-18 | 2015-04-08 | 大连理工大学 | 一种节能快速无线成像方法 |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9793988B2 (en) * | 2014-11-06 | 2017-10-17 | Facebook, Inc. | Alignment in line-of-sight communication networks |
| US10113877B1 (en) * | 2015-09-11 | 2018-10-30 | Philip Raymond Schaefer | System and method for providing directional information |
| CN107345812A (zh) * | 2016-05-06 | 2017-11-14 | 湖北淦德智能消防科技有限公司 | 一种图像定位方法、装置及手机 |
| US11300649B1 (en) * | 2017-06-24 | 2022-04-12 | Robotic Research Opco, Llc | Vehicle localization augmentation for dismounts |
| US10345428B1 (en) * | 2018-06-08 | 2019-07-09 | Bae Systems Information And Electronic Systems Integration Inc. | Angle-based multiple-source geolocation method and geolocation geometry evaluation based on covariance matrix |
| WO2021037359A1 (fr) * | 2019-08-28 | 2021-03-04 | Nokia Technologies Oy | Optimisation d'attribution de ressources par vision informatique |
| JP2022545294A (ja) * | 2019-08-29 | 2022-10-26 | エルジー エレクトロニクス インコーポレイティド | 無線通信システムにおいて端末の位置を測定する方法及び装置 |
| EP4027717B1 (fr) * | 2019-10-15 | 2024-07-31 | LG Electronics Inc. | Procédé de positionnement dans un système de communication sans fil et dispositif correspondant |
| JP2021131652A (ja) * | 2020-02-19 | 2021-09-09 | 株式会社トプコン | データ構造、記録媒体、プログラム、及びシステム |
| US11030456B1 (en) * | 2021-01-29 | 2021-06-08 | Booz Allen Hamilton Inc. | Systems and methods for geo-localization in sensor-deprived or sensor-limited environments |
| US12493116B2 (en) * | 2022-12-13 | 2025-12-09 | Qualcomm Incorporated | Visual sensing for positioning |
| WO2024137046A1 (fr) * | 2022-12-22 | 2024-06-27 | Qualcomm Incorporated | Informations d'état de canal (vcsi) à base visuelle pour améliorer l'attribution de ressources |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8942483B2 (en) * | 2009-09-14 | 2015-01-27 | Trimble Navigation Limited | Image-based georeferencing |
| US8712439B2 (en) * | 2008-01-11 | 2014-04-29 | Qualcomm Incorporated | Method and apparatus for using service capability information for user plane location |
| US8639271B2 (en) * | 2008-07-02 | 2014-01-28 | Qualcomm Incorporated | Method and apparatus for supporting location-based services by a removable module |
| US8538688B2 (en) * | 2008-11-18 | 2013-09-17 | Nokia Corporation | User generated pedestrian and indoor shortcut routes for navigation systems |
| US8862395B2 (en) * | 2011-01-31 | 2014-10-14 | Raytheon Company | Coded marker navigation system and method |
| US20120300020A1 (en) * | 2011-05-27 | 2012-11-29 | Qualcomm Incorporated | Real-time self-localization from panoramic images |
| US8787944B2 (en) * | 2011-08-18 | 2014-07-22 | Rivada Research, Llc | Method and system for providing enhanced location based information for wireless handsets |
-
2013
- 2013-12-27 EP EP13826662.2A patent/EP2943804B1/fr active Active
- 2013-12-27 WO PCT/SE2013/051621 patent/WO2014109694A2/fr not_active Ceased
- 2013-12-27 US US14/758,931 patent/US20150339823A1/en not_active Abandoned
Non-Patent Citations (1)
| Title |
|---|
| None |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104502884A (zh) * | 2014-12-18 | 2015-04-08 | 大连理工大学 | 一种节能快速无线成像方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2943804B1 (fr) | 2016-09-28 |
| EP2943804A2 (fr) | 2015-11-18 |
| US20150339823A1 (en) | 2015-11-26 |
| WO2014109694A3 (fr) | 2014-09-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2943804B1 (fr) | Prise en charge et amélioration de localisation à base d'image | |
| US9374662B2 (en) | Enhancing positioning in multi-PLMN deployments | |
| US8626191B2 (en) | Node and method in a node | |
| CN116325826A (zh) | 射频感测通信 | |
| US8855677B2 (en) | Nodes and methods for positioning | |
| US12206610B2 (en) | Reference selection for double difference positioning | |
| WO2013062462A1 (fr) | Positionnement mobile faisant appel à des empreintes radio comprenant une vitesse ou un défilement du temps de propagation | |
| US12382426B2 (en) | Positioning and beam alignment based on optical sensing | |
| JP2023524294A (ja) | ダイナミックスペクトルシェアリングのための効率的な測位機能拡張 | |
| CN103404177B (zh) | 用于定位的节点和方法 | |
| WO2013141771A1 (fr) | Amélioration du positionnement de liaison montante | |
| WO2022154861A1 (fr) | Sélection de référence pour positionnement à double différence | |
| EP4308956A2 (fr) | Sélection de signal de référence de positionnement à la demande pour des schémas de positionnement à double différence | |
| EP3756026A1 (fr) | Positionnement 3d à tdoa mis à l'échelle | |
| US20240276272A1 (en) | Prioritization criteria for positioning measurements in a time window measurement scheme | |
| US20200393531A1 (en) | Signaling of scaled 3d position information | |
| CN115769086A (zh) | 用户设备传感器校准 | |
| EP2880932A2 (fr) | Obtention et utilisation de mesures composites pour positionnement | |
| US12526110B2 (en) | Processing non-contiguous stitched positioning reference signals | |
| US20250227655A1 (en) | User equipment assisted mapping of access points | |
| US12618963B2 (en) | Radio frequency sensing communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13826662 Country of ref document: EP Kind code of ref document: A2 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| REEP | Request for entry into the european phase |
Ref document number: 2013826662 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2013826662 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 14758931 Country of ref document: US |