WO2013135132A1 - 移动增强现实搜索方法、客户端、服务器及搜索系统 - Google Patents

移动增强现实搜索方法、客户端、服务器及搜索系统 Download PDF

Info

Publication number
WO2013135132A1
WO2013135132A1 PCT/CN2013/071779 CN2013071779W WO2013135132A1 WO 2013135132 A1 WO2013135132 A1 WO 2013135132A1 CN 2013071779 W CN2013071779 W CN 2013071779W WO 2013135132 A1 WO2013135132 A1 WO 2013135132A1
Authority
WO
WIPO (PCT)
Prior art keywords
augmented reality
target
mobile
search
relationship
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/071779
Other languages
English (en)
French (fr)
Inventor
黄成�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to EP13760820.4A priority Critical patent/EP2827617A4/en
Priority to US14/385,246 priority patent/US20150081675A1/en
Priority to JP2014561271A priority patent/JP5970565B2/ja
Publication of WO2013135132A1 publication Critical patent/WO2013135132A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9538—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information

Definitions

  • the present invention relates to the field of communications, and in particular to a mobile augmented reality search method, a client, a server, and a search system.
  • Augmented Reality AR
  • a large number of Internet/mobile Internet AR applications based on image recognition and terminal location technology have emerged, called Mobile Augmented Reality (Mobile AR, referred to as MobAR) applications, which has attracted much attention from the industry and become a hot research topic.
  • MobAR Mobile Augmented Reality
  • the research and application of mobile augmented reality technology the application of virtual augmented reality information to the real world, changing the way users observe the surrounding world.
  • the traditional text-based WEB page browsing query mode is changed to camera-based shooting, capturing hotspots. And browse the new mode of enhanced information in real time.
  • MobAR users can use mobile terminals (eg, smartphones) to get an augmented reality business experience while capturing surrounding scenes.
  • the augmented reality application (AR Application) running on the mobile terminal captures an AR target deployed by the AR service provider based on the current location of the user, for example, a POI associated with a geographic location, and according to The user chooses to obtain AR Content, which includes: text, pictures, voice, and video.
  • AR Content which includes: text, pictures, voice, and video.
  • the acquired augmented reality content is displayed on the screen together with the surrounding real scene captured by the terminal camera to obtain an unusual augmented reality service experience.
  • MobAR users When using augmented reality services, MobAR users sometimes want to be able to continuously access related augmented reality information. For example: When shopping, users hope to determine how to purchase by comparing similar augmented reality content.
  • the augmented reality content here is mainly service description. Or product advertising, etc.
  • the existing augmented reality application only searches for a point of interest based on the user's location or the current camera capture real scene, that is, if a point of interest enters the user's preset search range or is captured by the camera, the point of interest will be searched and returned.
  • Related augmented reality content otherwise the user will not know the existence of the point of interest, and will not be able to obtain related augmented reality content.
  • the above processing methods have certain drawbacks.
  • the present invention provides a mobile augmented reality search method, a client, a server, and a search system to at least solve the technical problem in the prior art that the augmented reality information acquired by the user is incomplete due to the search based on the augmented reality target itself.
  • a mobile augmented reality search method including: a mobile augmented reality server receiving an augmented reality target search request sent by a mobile augmented reality client; and a mobile augmented reality server carrying the augmented reality target search request Searching for parameters, searching for augmented reality targets that need to be identified and returned; the mobile augmented reality server searching for augmented reality targets associated with the augmented reality targets that have been searched; and the mobile augmented reality server returning information of the augmented reality targets that are searched back to the mobile enhancement Realistic client.
  • the step of the mobile augmented reality server searching for the augmented reality target associated with the searched augmented reality target comprises: the mobile augmented reality server determining the augmented reality target association relationship according to the first indicator in the search parameter; The server searches for an augmented reality target with an augmented reality target association with the augmented reality target that has been searched.
  • the augmented reality target association relationship comprises at least one of the following: an inclusion relationship, an included relationship, and an adjacent relationship.
  • the augmented reality target association relationship comprises at least one of the following: a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the step of the mobile augmented reality server searching for the augmented reality target associated with the searched augmented reality target comprises: the mobile augmented reality server determining whether there is a second indicator in the search parameter, wherein the second indicator is used to indicate Searching for an augmented reality target associated with the augmented reality target that has been searched; if there is a second indicator, the mobile augmented reality server further searches for an augmented reality target associated with the augmented reality target that has been searched.
  • the mobile augmented reality search method further comprises: the mobile augmented reality server determining whether there is a third indicator in the search parameter, wherein a third indicator for indicating augmented reality content corresponding to the augmented reality target associated with the searched augmented reality target; if there is a third indicator, the mobile augmented reality server searches for the augmented reality target that has been searched Augmented reality content corresponding to the associated augmented reality target.
  • another mobile augmented reality search method including: a mobile augmented reality server receiving an augmented reality content acquisition request sent by a mobile augmented reality client; and a mobile augmented reality server according to the augmented reality content acquisition request Carrying parameters, searching for augmented reality content that needs to be retrieved and returned; the mobile augmented reality server searches for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content; the augmented reality content that the mobile augmented reality server will acquire and The acquired augmented reality content corresponds to the augmented reality target associated with the augmented reality target information returned to the mobile augmented reality client.
  • the step of the mobile augmented reality server searching for the augmented reality target associated with the augmented reality target corresponding to the augmented reality content comprises: the mobile augmented reality server determining the augmented reality target association relationship according to the first indicator in the parameter; The server searches for an augmented reality target having an augmented reality target association relationship between the augmented reality targets corresponding to the acquired augmented reality content.
  • the augmented reality target association relationship comprises at least one of the following: a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the step of the mobile augmented reality server searching for the augmented reality target associated with the augmented reality target corresponding to the augmented reality content comprises: determining whether a second indicator exists in the mobile augmented reality server determining parameter, wherein the second indicator is used to indicate Searching for an augmented reality target associated with the acquired augmented reality content corresponding to the augmented reality target; if there is a second indicator, the mobile augmented reality server further searching for the augmented reality associated with the augmented reality target corresponding to the acquired augmented reality content aims.
  • the method further includes: determining, by the mobile augmented reality server, whether there is a third indicator, wherein the third indicator And augmented reality content corresponding to the augmented reality target associated with the augmented reality object corresponding to the acquired augmented reality content; if there is a third indicator, the mobile augmented reality server searches for the augmented reality content corresponding to the acquired augmented reality content Augmented reality content corresponding to the augmented reality target associated with the augmented reality goal.
  • a mobile augmented reality search method including: a mobile augmented reality client providing a search parameter in an augmented reality target search request according to a user context and/or a user preference, wherein the search parameter is used
  • the mobile augmented reality server is requested to search for the augmented reality target, and the augmented reality target associated with the augmented reality target is searched; the mobile augmented reality client sends the augmented reality target search request to the mobile augmented reality server.
  • the step of providing the search parameter in the augmented reality target search request according to the user context and/or the user preference by the mobile augmented reality client comprises: the mobile augmented reality client adding the first indicator in the search parameter, The first indicator is used to indicate an augmented reality target association relationship to request the mobile augmented reality server to search for an augmented reality target having an augmented reality target association relationship with the augmented reality target.
  • the augmented reality target association relationship comprises at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the step of providing the search parameter in the augmented reality target search request according to the user context and/or the user preference according to the user context and/or the user preference comprises: the mobile augmented reality client adding a second indicator in the search parameter, wherein the second indication The token is used to indicate a search for an augmented reality target associated with the augmented reality target.
  • the step of providing the search parameter in the augmented reality target search request according to the user context and/or the user preference according to the user context and/or the user preference comprises: the mobile augmented reality client carrying the third indicator in the search parameter, wherein the third indicator The symbol is used to instruct the mobile augmented reality server to search for augmented reality content corresponding to the augmented reality object associated with the augmented reality object that needs to be identified and returned.
  • a mobile augmented reality search method including: a mobile augmented reality client providing a parameter in an augmented reality content acquisition request, wherein the parameter is used to request the mobile augmented reality server to acquire the augmented reality content And searching for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content; the mobile augmented reality client transmitting the augmented reality content acquisition request to the mobile augmented reality server.
  • the step of the mobile augmented reality client providing the parameter in the augmented reality content acquisition request comprises: adding, by the mobile augmented reality client, a first indicator, wherein the first indicator is used to indicate the augmented reality target association relationship,
  • the augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content is requested to be requested by the mobile augmented reality server.
  • the augmented reality target association relationship comprises at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the step of the mobile augmented reality client providing the parameter in the augmented reality content acquisition request comprises: adding, by the mobile augmented reality client, a second indicator, wherein the second indicator is used to indicate the augmented reality of the acquired and acquired The augmented reality target associated with the augmented reality target corresponding to the content is searched.
  • the step of providing the parameter in the augmented reality content acquisition request by the mobile augmented reality client comprises: the mobile augmented reality client carrying the third indicator in the parameter, wherein the third indicator is used to indicate that the mobile augmented reality server acquires The acquired augmented reality content corresponds to the augmented reality content corresponding to the augmented reality target associated with the augmented reality target.
  • a mobile augmented reality search method including: a mobile augmented reality client receiving an augmented reality target search response returned by a mobile augmented reality server; and a mobile augmented reality client extracting an augmented reality target search response
  • the information of the augmented reality target carried in the mobile augmented reality client displays the association relationship between the augmented reality targets according to the information of the augmented reality target.
  • the step of the mobile augmented reality client displaying the association relationship between the augmented reality targets comprises: the mobile augmented reality client displaying an association relationship between all augmented reality targets within the search range; or the mobile augmented reality client displaying an enhancement The relationship between the actual goals.
  • a mobile augmented reality server comprising: a receiving unit, configured to receive an augmented reality target search request sent by a mobile augmented reality client; a first searching unit configured to search according to an augmented reality target a search parameter carried in the request, searching for an augmented reality target that needs to be recognized and returned; a second search unit, configured to search for an augmented reality target associated with the searched augmented reality target; a return unit, set to be searched The information of the augmented reality target is returned to the mobile augmented reality client.
  • a mobile augmented reality server comprising: a receiving unit, configured to receive an augmented reality content acquisition request sent by a mobile augmented reality client; a first searching unit, configured to be based on augmented reality content Obtaining a parameter carried in the request, searching for augmented reality content that needs to be acquired and returned; a second search unit, configured to search for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content; returning unit, set to be The acquired augmented reality content and the information of the augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content are returned to the mobile augmented reality client.
  • a mobile augmented reality client comprising: a providing unit configured to provide a search parameter in an augmented reality target search request according to a user context and/or a user preference, wherein the search parameter is used for Requesting the mobile augmented reality server to search for the augmented reality target and the augmented reality target associated with the augmented reality target; the sending unit, configured to send the augmented reality target search request to the mobile augmented reality server.
  • a mobile augmented reality client comprising: a providing unit, configured to provide a parameter in an augmented reality content acquisition request, wherein the parameter is used to request the mobile augmented reality server to acquire the augmented reality content And searching for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content; the sending unit, configured to send the augmented reality content acquisition request to the mobile augmented reality server.
  • a mobile augmented reality client comprising: a receiving unit configured to receive an augmented reality target search response returned by a mobile augmented reality server; and an extracting unit configured to extract an augmented reality target search response
  • the information of the augmented reality target carried in the display unit is configured to display an association relationship between the augmented reality objects according to the information of the augmented reality target.
  • a mobile augmented reality search system is provided, including the mobile augmented reality server described above and the mobile augmented reality client described above.
  • the mobile augmented reality server performs the search of the associated augmented reality target according to the augmented reality target search request or the indication information of the search-associated augmented reality target carried in the augmented reality content acquisition request, which solves the prior art.
  • the problem of incomplete search results caused by searching only the objects in the request achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information and improve the information.
  • FIG. 1 is a preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 2 is another preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 1 is a preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 2 is another preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 1 is a preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 2 is another preferred flowchart of a mobile augmented reality search method according to an embodiment of the present invention
  • FIG. 1 is a preferred flowchart of a mobile
  • FIG. 10 is another schematic structural diagram of a mobile augmented reality system architecture based on a relational interest point according to an embodiment of the present invention
  • FIG. 11 is still another structure of a mobile augmented reality system architecture based on a relational interest point according to an embodiment of the present invention.
  • FIG. 12 is a preferred flowchart of a search method for moving an augmented reality server service request based on a relational point of interest according to an embodiment of the present invention
  • FIG. 13 is a mobile augmented reality server based on a relational point of interest according to an embodiment of the present invention;
  • FIG. 12 is a preferred flowchart of a search method for moving an augmented reality server service request based on a relational point of interest according to an embodiment of the present invention
  • FIG. 13 is a mobile augmented reality server based on a relational point of interest according to an embodiment of the present invention
  • FIG. 14 is another preferred flowchart of a search method for moving an augmented reality server service request based on a relational point of interest according to an embodiment of the present invention
  • FIG. 15 is an implementation according to the present invention.
  • FIG. 16 is another interaction diagram of a search method for moving an augmented reality server service request based on a relational point of interest according to an embodiment of the present invention
  • FIG. 17 is a relational type according to an embodiment of the present invention
  • Embodiment 1 The embodiment of the present invention provides a preferred mobile augmented reality search method, which is mainly performed based on an augmented reality target search request. As shown in FIG. 1 , the specific steps of the method include:
  • the mobile augmented reality client provides a search parameter in the augmented reality target search request according to the user context and/or the user preference, wherein the search parameter is used to request the mobile augmented reality server to search for the augmented reality target, and the search is associated with the augmented reality target.
  • Augmented reality goal ;
  • the mobile augmented reality client sends the augmented reality target search request to the mobile augmented reality server.
  • the mobile augmented reality client adds the indication information of the search for the associated augmented reality target in the generated augmented reality target search request, and implements the associated augmented reality target search, and solves the problem in the prior art.
  • the problem of incomplete search results caused by only searching the objects in the request achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information and enhance the enhancement.
  • the user context described above is the state of the user, which may include, but is not limited to, the user's geographic location and/or user presence information.
  • the mobile augmented reality client may provide the search parameter in the augmented reality target search request according to the user context and/or the user preference as follows:
  • the mobile augmented reality client adds the first indicator to the search parameter,
  • the first indicator is used to indicate an augmented reality target association relationship to request the mobile augmented reality server to search for an augmented reality target having an augmented reality target association relationship with the augmented reality target.
  • the augmented reality target association relationship includes but is not limited to at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the first indicator may be a search parameter value of an "associated augmented reality target search relationship."
  • the mobile augmented reality client may also add other indication information to the search parameter according to the user context and/or the user preference.
  • the mobile augmented reality client adds a second indicator to the search parameter, where A second indicator is used to indicate a search for an augmented reality target associated with the augmented reality target.
  • the second indicator may be an "associated augmented reality target search indicator”.
  • the step of providing the search parameter in the augmented reality target search request according to the user context and/or the user preference by the mobile augmented reality client comprises: the mobile augmented reality client carrying the third indicator in the search parameter, wherein And a third indicator is used to instruct the mobile augmented reality server to search for augmented reality content corresponding to the augmented reality target associated with the augmented reality target that needs to be recognized and returned.
  • the third indicator may be an "Augmented Reality Content Cache Indicator".
  • the mobile augmented reality server performs the search for the augmented reality target based on the augmented reality target search request.
  • the embodiment of the present invention provides a specific search method. As shown in FIG. 2, the method includes:
  • the mobile augmented reality server receives the augmented reality target search request sent by the mobile augmented reality client;
  • the mobile augmented reality server searches for an augmented reality target that needs to be identified and returned according to the search parameter carried in the augmented reality target search request.
  • the mobile augmented reality server searches for an augmented reality target associated with the searched augmented reality target;
  • the mobile augmented reality server returns the information of the searched augmented reality target to the mobile augmented reality client.
  • the mobile augmented reality server performs the search of the associated augmented reality target according to the indication information of the search-associated augmented reality target carried in the augmented reality target search request, and solves the problem in the prior art only for the request.
  • the problem of incomplete search results caused by the search of the objects in the object achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information and improve the augmented reality application. user experience.
  • the mobile augmented reality server may search for an augmented reality target associated with the searched augmented reality target in the following manner: The mobile augmented reality server determines the augmented reality target association based on the first indicator in the search parameter Relationship; augmented reality target with augmented reality target association between the mobile augmented reality server search and the searched augmented reality target.
  • the augmented reality target association relationship includes but is not limited to at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the mobile augmented reality server may search for an augmented reality target associated with the searched augmented reality target as follows: the mobile augmented reality server determines whether there is a second indicator in the search parameter, wherein the a second indicator for indicating a search for an augmented reality target associated with the searched augmented reality target; if there is a second indicator, the mobile augmented reality server further searching for an enhancement associated with the searched augmented reality target Realistic goal. That is, if the second parameter is carried in the search parameter (the second indicator may be the associated augmented reality target search indicator), the augmented reality target associated with the searched augmented reality target is searched, otherwise Target search without association.
  • the mobile augmented reality search method further comprises: the mobile augmented reality server determining whether the search parameter has a third An indicator, wherein the third indicator is used to indicate that the augmented reality content corresponding to the augmented reality target associated with the searched augmented reality target is searched; if the third indicator is present, the mobile augmented reality server searches and searches Augmented reality content corresponding to the augmented reality target associated with the augmented reality target. That is, if the search parameter carries a third indicator (the third indicator may be an augmented reality content cache indicator), the augmented reality content corresponding to the augmented reality target associated with the searched augmented reality target is performed. Search, otherwise do not perform an associated content search.
  • the searched information needs to be displayed.
  • the embodiment of the present invention further provides an augmented reality display method. As shown in FIG. 3, the specific steps include:
  • the mobile augmented reality client receives the augmented reality target search response returned by the mobile augmented reality server;
  • S304 the mobile augmented reality client extracts the information of the augmented reality target carried in the augmented reality target search response;
  • the mobile augmented reality client displays the relationship between the augmented reality targets according to the information of the augmented reality target.
  • the mobile augmented reality client displays the association relationship between all augmented reality targets within the search range;
  • the mobile augmented reality client displays the association relationship corresponding to an augmented reality target.
  • the above-mentioned associations include, but are not limited to, at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • An embodiment of the present invention provides a preferred mobile augmented reality search system. As shown in FIG. 4, the present invention includes: a mobile augmented reality server 402 and a mobile augmented reality client 404.
  • the mobile augmented reality server 402 includes: a first receiving unit 4022, configured to receive an augmented reality target search request sent by the mobile augmented reality client; the first searching unit 4024, coupled with the first receiving unit 4022, configured to be enhanced according to the The search parameters carried in the realistic target search request search for the augmented reality target that needs to be recognized and returned; the second search unit 4026, coupled with the first search unit 4024, is configured to search for enhancements associated with the augmented reality targets that have been searched.
  • the realistic target; first return unit 4028, coupled with the second search unit 4026, is configured to return the information of the searched augmented reality target to the mobile augmented reality client.
  • the mobile augmented reality client 404 includes: a first providing unit 4042, configured to provide a search parameter in an augmented reality target search request according to a user context and/or a user preference, wherein the search parameter is used to request the mobile augmented reality server to search for augmented reality The target and the augmented reality target associated with the augmented reality target; the first sending unit 4044, coupled to the first providing unit 4042, is configured to send the augmented reality target search request to the mobile augmented reality server.
  • a first providing unit 4042 configured to provide a search parameter in an augmented reality target search request according to a user context and/or a user preference, wherein the search parameter is used to request the mobile augmented reality server to search for augmented reality The target and the augmented reality target associated with the augmented reality target
  • the first sending unit 4044 coupled to the first providing unit 4042, is configured to send the augmented reality target search request to the mobile augmented reality server.
  • the mobile augmented reality client 404 may further include: a second receiving unit 502, configured to receive an augmented reality target search response returned by the mobile augmented reality server; the extracting unit 504, and the The receiving unit 502 is coupled to set information for extracting the augmented reality target carried in the augmented reality target search response.
  • the display unit 506 is coupled to the extracting unit 504 and configured to display the relationship between the augmented reality targets according to the information of the augmented reality target. .
  • the specific implementation steps of the augmented reality search system in the augmented reality search system in FIG. 4 and FIG. 5 may be described in the foregoing preferred embodiments, and details are not described herein again.
  • Embodiment 2 The embodiment of the present invention further provides a preferred mobile augmented reality search method, which is mainly performed based on an augmented reality content acquisition request. As shown in FIG. 6, the specific steps of the method include:
  • the mobile augmented reality client provides a parameter in the augmented reality content acquisition request, where the parameter is used to request the mobile augmented reality server to acquire the augmented reality content, and search for the augmented reality associated with the augmented reality target corresponding to the acquired augmented reality content.
  • the mobile augmented reality client sends an augmented reality content acquisition request to the mobile augmented reality server.
  • the mobile augmented reality client adds the indication information of the searched augmented reality target in the generated augmented reality content acquisition request, and realizes the search of the associated augmented reality target and its content, and solves the present problem.
  • the problem that the search result is not comprehensive due to only searching the object in the request achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information. , improving the user experience of augmented reality applications.
  • the mobile augmented reality client may provide parameters in the augmented reality content acquisition request as follows:
  • the mobile augmented reality client adds a first indicator to the parameter, wherein the first indicator is used to indicate enhancement
  • the realistic target association relationship is requested to request the mobile augmented reality server to search for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content.
  • the augmented reality target association relationship includes but is not limited to at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the first indicator may be a parameter value of the "associated augmented reality target search relationship.”
  • the mobile augmented reality client may also add other indication information to the parameter.
  • the mobile augmented reality client adds a second indicator to the parameter, wherein the second indicator is used to indicate the pairing and obtaining The augmented reality content corresponds to the augmented reality target associated with the augmented reality target for searching.
  • the second indicator may be an "associated augmented reality target search indicator”.
  • the step of providing the mobile augmented reality client in the augmented reality content acquisition request comprises: the mobile augmented reality client carrying the third indicator in the parameter, wherein the third indicator is used to indicate the mobile enhancement
  • the real server acquires augmented reality content corresponding to the augmented reality target associated with the acquired augmented reality content corresponding to the augmented reality object.
  • the third indicator may be an "Augmented Reality Content Cache Indicator".
  • the mobile augmented reality server After the step S604, the mobile augmented reality server performs the search of the augmented reality target and the content based on the augmented reality content acquisition request.
  • the specific search process includes: S702: The mobile augmented reality server receives the mobile augmented reality client. Augmented reality content acquisition request sent;
  • the mobile augmented reality server searches for the augmented reality content that needs to be acquired and returned according to the parameter carried in the augmented reality content acquisition request.
  • the mobile augmented reality server searches for an augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content;
  • the mobile augmented reality server returns the acquired augmented reality content and the information of the augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content to the mobile augmented reality client.
  • the mobile augmented reality server performs the search of the associated augmented reality target and its content according to the indication information of the search-associated augmented reality target carried in the augmented reality content acquisition request, and solves the problem in the prior art.
  • the problem of incomplete search results caused by only searching the objects in the request achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information and enhance the enhancement. User experience of real-world applications.
  • the mobile augmented reality server may search for an augmented reality target associated with the augmented reality object corresponding to the augmented reality content: the mobile augmented reality server determines the augmented reality target association according to the first indicator in the parameter Relationship; the mobile augmented reality server searches for an augmented reality target having an augmented reality target association relationship between the augmented reality targets corresponding to the acquired augmented reality content.
  • the augmented reality target association relationship includes but is not limited to at least one of the following: an inclusion relationship, an included relationship, an adjacent relationship, a father relationship, a child relationship, a historical relationship, and a future relationship.
  • the mobile augmented reality server may search for an augmented reality target associated with the augmented reality target corresponding to the augmented reality content: the mobile augmented reality server determines whether there is a second indicator in the parameter, wherein the The second indicator is configured to instruct to search for the augmented reality target associated with the acquired augmented reality content corresponding to the augmented reality target; if the second indicator is present, the mobile augmented reality server further searches for the augmented reality corresponding to the acquired augmented reality content Augmented reality goals associated with the goal. That is, if the parameter carries a second indicator (which may be an associated augmented reality target search indicator), the augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content is searched. , otherwise the associated target search is not performed.
  • a second indicator which may be an associated augmented reality target search indicator
  • the method further includes: determining, by the mobile augmented reality server, whether a third indicator exists in the parameter, wherein The third indicator is used to indicate that the augmented reality content corresponding to the augmented reality target associated with the acquired augmented reality content is acquired; if the third indicator is present, the mobile augmented reality server searches and acquires the enhancement The augmented reality content corresponding to the augmented reality target associated with the augmented reality target corresponding to the real content.
  • the parameter carries a third indicator (which may be an augmented reality content cache indicator), the augmented reality corresponding to the augmented reality target associated with the augmented reality target corresponding to the acquired augmented reality content
  • the content is searched, otherwise the associated content search is not performed.
  • the embodiment of the present invention further provides a preferred augmented reality search system.
  • the system includes: a mobile augmented reality server 802 and a mobile augmented reality client 804, where the mobile augmented reality server 802 includes:
  • the third receiving unit 8022 is configured to receive the augmented reality content acquisition request sent by the mobile augmented reality client.
  • the third searching unit 8024 is coupled to the third receiving unit 8022 and configured to perform the search according to the parameter carried in the augmented reality content acquisition request.
  • the mobile augmented reality client 804 can include: a second providing unit 8042, configured to provide a parameter in the augmented reality content acquisition request, wherein the parameter is used to request the mobile augmented reality server to acquire the augmented reality content, and the augmented reality of the search and acquisition
  • the augmented reality target associated with the augmented reality target corresponding to the content is configured to send the augmented reality content acquisition request to the mobile augmented reality server.
  • the specific execution steps of the augmented reality search system in FIG. 8 for implementing the augmented reality search method may be as described in the above various preferred embodiments, and details are not described herein again.
  • the mobile augmented reality system architecture based on the point of interest (P0I) proposed by the present invention includes: a mobile augmented reality server 100, an augmented reality content server 200, a communication network 300, The augmented reality terminal 400 and the mobile augmented reality client 500 are moved.
  • P0I point of interest
  • the mobile augmented reality server 100 is a functional entity on the network side of the mobile augmented reality system, and is responsible for searching for augmented reality targets, selecting and acquiring augmented reality content according to the mobile augmented reality client 500 request, and the user augmented reality personalization and context settings. As shown in FIG. 10, the following functional entities are mainly included: an augmented reality content/target selection function 110, which is set to be requested in the mobile augmented reality server 100 according to the received mobile augmented reality client 500, or with an augmented reality target and/or enhancement
  • the real content delivers relevant push requests, searches for augmented reality targets, and selects and acquires augmented reality content.
  • the augmented reality target search unit 111 is configured to construct an augmented reality target search condition according to the augmented reality target search parameter carried by the augmented reality target search request, and augmented reality personalization and context, and transmit the enhanced content to the augmented reality content/target management function 120.
  • the augmented reality target search parameter may include, but is not limited to, at least one of the following: enhancing the current user location information, for example: latitude and longitude; augmented reality target search radius, search category Augmented reality target types, such as: POI (point of interest); augmented reality target features, such as: open time, price range; associated augmented reality target search indicator; associated augmented reality target search relationship, search relationship includes: "relationship," is included in "relationship,
  • Augmented reality content cache indicators such as: cached, not cached.
  • the "associated augmented reality target search indicator” described above is used to indicate that other augmented reality targets associated with the matched augmented reality target are simultaneously searched. If there is an associated augmented reality target search indicator in the augmented reality target search request, the augmented reality content/target selection function 110 returns a "Relationship" relationship attribute in the augmented reality target information according to the search match, SP, associated augmented reality target search. Relationships, further searching for other associated augmented reality goals; otherwise, the augmented reality content/target selection function 110 only returns search-matched augmented reality targets.
  • the "associated augmented reality target search relationship" described above is used to indicate the basis of the search relationship that is followed when searching for the associated augmented reality target. Used to represent an augmented reality goal associated with a search "contains” relationship, or to search for an augmented reality goal associated with a "contained” relationship, or to search for an augmented reality goal associated with an "adjacent” relationship, preferably, The default search for associated augmented reality targets under all relationships.
  • the above-mentioned "Augmented Reality Content Cache Indicator” is used to represent the augmented reality content corresponding to the cache, that is, the augmented reality content of the associated augmented reality object is acquired if there is a strong reality content cache indicator in the augmented reality target search request.
  • the augmented reality content obtaining unit 112 is configured to, according to the augmented reality content acquisition parameter carried by the augmented reality content acquisition request, and the augmented reality personalization and context, construct the augmented reality content acquisition condition, and send the augmented reality to the augmented reality content/target management function 120.
  • the content acquisition request, the acquired augmented reality content collection, the augmented reality content acquisition parameter including but not limited to at least one of: augmented reality content identifier, or associated augmented reality target identifier; augmented reality content feature, for example: media type , charged price; associated augmented reality target search indicator; associated augmented reality target search relationship, search relationship includes: "contains” relationship, "included” relationship, "adjacent” relationship, etc.; augmented reality content cache indicator, Used to indicate that the augmented reality content corresponding to the associated augmented reality target is cached.
  • the augmented reality content/target management function 120 is configured to store and manage information related to augmented reality target deployment and augmented reality content release, including:
  • the relationship-based POI augmented reality target information management includes at least: augmented reality target identifier, augmented reality target type, classification, description, corresponding augmented reality content identifier, and associated augmented reality target relationship information, including at least: "including" relationship, Contains "relationship," adjacent relationship; corresponding to augmented reality content information management, including at least: augmented reality content identification, augmented reality target identification, augmented reality content publishing status, augmented reality content deployment rules, and augmented reality content access addresses and An access control policy or the like; an augmented reality personalization and context function 130, configured to manage user personalized preferences and user contexts, wherein the user personalized preferences include, but are not limited to, at least one of: augmented reality target search preferences, eg: search radius , search categories, augmented reality target features, etc.; augmented reality content acquisition preferences, such as: augmented reality content features, etc.; associated augmented reality
  • the augmented reality content server 200 is a functional entity deployed by the augmented reality content provider on the network side, and is provided to provide an augmented reality target that has been published with the mobile augmented reality server, for example, a relational point of interest POI.
  • Corresponding augmented reality content includes: multimedia information such as text, images, audio, and video.
  • the communication network 300 is provided as a wired and wireless communication network that provides a network communication link between the mobile augmented reality server 100 and the augmented reality terminal 400.
  • the augmented reality terminal 400 is a mobile terminal with augmented reality service function used by the user, and is configured to provide a basic communication function and provide an augmented reality service experience for the user.
  • the method includes: a camera 410 configured to capture a physical world around the user in real time.
  • Real-life information (Camera View;). Some cameras have video memory, and can capture the captured real-life information; the display screen 420 is configured to present the Augmented Reality View (AR View) to the user by presenting the camera 531 to capture the real-life information under the augmented reality content modification rendering;
  • AR View Augmented Reality View
  • GPS module GPS module, compass, sensor, etc. 430, wherein the GPS module communicates with a Global Position System (GPS) satellite to provide terminal location information (latitude and longitude) in real time.
  • GPS Global Position System
  • the sensor is used to collect the status of the user terminal, where the status of the user terminal may include, but is not limited to: a camera orientation, an angle with the ground, and the like;
  • the mobile augmented reality client 500 is a terminal entity function of the mobile augmented reality service system, responsible for moving
  • the augmented reality server 100 sends an augmented reality target search request, is set to select and acquire the augmented reality content, and provides the mobile augmented reality service support capability to the augmented reality terminal augmented reality application. As shown in FIG.
  • the content/target acquisition function 510 is configured to receive a request to run the augmented reality application on the augmented reality terminal 300, and contact the mobile augmented reality server 100 to request to search for the augmented reality target to acquire the augmented reality content. In the present invention, it is responsible for transmitting the augmented reality object information including the associated augmented reality object returned by the search to the augmented reality content display function 520.
  • the augmented reality content display function 520 is configured to control the augmented reality content/target acquisition function 510 to acquire the augmented reality content and the camera 410 to capture the real scene on the display screen 420 according to the state of the augmented reality terminal 300.
  • the augmented reality target relationship extraction unit 521 is configured to extract the relationship information between the associated augmented reality objects included in the augmented reality target information transmitted by the augmented reality content/target acquisition function 510, and at least includes: “includes” and “includes” , "adjacent” relationship.
  • the augmented reality content presentation control unit 522 is configured to control the augmented reality content including the relationship information between the associated augmented reality targets extracted by the augmented reality target relationship extraction unit 521 according to the augmented reality content presentation indication delivered by the user interaction support function 530.
  • the display includes at least: a global association augmented reality target relationship display, that is, displaying relationship information between all the search returns to the augmented reality target; a single association augmented reality target relationship display, and displaying information related to an augmented reality target.
  • the user interaction support function 530 receives a user input interaction instruction, and triggers a business logic such as augmented reality target search, augmented reality content acquisition, and display.
  • a business logic such as augmented reality target search, augmented reality content acquisition, and display.
  • the interactive instruction is displayed according to the augmented reality content input by the user, and the augmented reality content display function 520 is instructed to perform business logic related to the augmented reality content presentation control.
  • the embodiment of the present invention further provides a search method for moving augmented reality server service request based on a relational point of interest. As shown in FIG.
  • Step S1202 The mobile augmented reality server receives the augmented reality service request sent by the mobile augmented reality client; step S1204: the mobile augmented reality server determines the augmented reality service request category, and if the augmented reality service request is the “augmented reality target search request”, execute In step S1206, if the augmented reality service request is "augmented reality content acquisition request", step S1216 is performed instead.
  • Step S1206 The mobile augmented reality server extracts the search parameters and searches for the matching augmented reality target;
  • Step S1208 the mobile augmented reality server searches for the search parameter value of the "associated augmented reality target search indicator" in the augmented reality target search request, and the augmented reality personality And augmenting the reality context, determining whether to search for the associated augmented reality target, if the augmented reality target search request carries the "associated augmented reality target search indicator", determining that the associated augmented reality target needs to be searched, performing step S1210, If the "associated augmented reality target search indicator" is not carried in the augmented reality target search request, it is determined that the search for the associated augmented reality target is not required, and then step S1214 is performed; step S1210: the mobile augmented reality server is based on the "associated enhancement" The search parameter value of the realistic target search relationship, searching for the augmented reality target associated with the search matching augmented reality target; step S1212: the mobile augmented reality server returns the searched augmented reality target and the associated augmented reality target, ending
  • Step S1220 The mobile augmented reality server directly returns the acquired augmented reality content, and ends the process.
  • Step S1224 The mobile augmented reality server determines, according to the parameter value of the "Augmented Reality Content Cache Indicator", and the augmented reality personalization and the augmented reality context, whether to obtain the augmented reality content corresponding to the associated augmented reality target, if the augmented reality content If the acquisition request carries the "Augmented Reality Content Cache Indicator", it is determined that the augmented reality content corresponding to the associated augmented reality target is not acquired, and step S1226 is performed; otherwise, step S1228 is performed; Step S1226: Moving the augmented reality server Returning the acquired augmented reality content and the associated augmented reality target obtained by the search, ending the process; Step S1228: The mobile augmented reality server acquires the corresponding augmented reality content according to the searched associated augmented reality target; Step S1230: Moving the augmented reality server Returning the acquired augmented reality content, and the associated augmented reality target information and corresponding augmented reality content obtained by the search.
  • the present invention further provides a method for generating an augmented reality service interaction request based on a relational point of interest mobile augmented reality client.
  • the specific steps include: Step S1302: The mobile augmented reality client receives the user augmented reality service interaction.
  • the target where the interaction indication information may be: the user requests to view the relationship information between the augmented reality targets, or the user preference setting, etc., if it is determined that the search for the associated augmented reality target, step S1308 is performed, otherwise, step S1310 is performed; Step S1308: The mobile augmented reality client adds an "associated augmented reality target search indicator" in the augmented reality service interaction request, and sets a search parameter value of the "associated augmented reality target search relationship", thereby generating an augmented reality target search request.
  • Step S1310 The mobile augmented reality client does not add the "associated augmented reality target search indicator" in the augmented reality service interaction request, and generates an augmented reality target search request.
  • Step S1312 For the "Augmented Reality Content Acquisition Request", the mobile augmented reality client determines whether to search for the associated augmented reality target according to the user preference setting, and if it is determined to search for the associated augmented reality target, step S1314 is performed, otherwise, Step S1320: Step S1314: The mobile augmented reality client further determines whether the augmented reality content corresponding to the associated augmented reality target is acquired at the same time, and if it is determined that the augmented reality content corresponding to the associated augmented reality target needs to be simultaneously acquired, performing the step S1316, otherwise, proceeding to step S1318; Step S1316: the mobile augmented reality client adds "associated augmented reality target search indicator" and "augmented reality content acquisition indicator", thereby generating an augmented reality content acquisition request, and The augmented reality content acquisition request is sent to the mobile augmented reality server, ending the process; step S1318: the mobile augmented reality client adds an "associated augmented reality target
  • the present invention also provides a method for displaying augmented reality content based on a relational point of interest mobile augmented reality client.
  • the specific steps include: Step S1402: The mobile augmented reality client receives the augmented reality content display request.
  • Step S1406 For the "global association style", the mobile augmented reality client extracts the global associated augmented reality target and displays it, ending the process; step S1408: for the "single association style", the mobile augmented reality client Augmented reality targets associated with a certain augmented reality goal are extracted and presented.
  • the present invention also provides a specific relationship-based point of interest mobile augmented reality method for searching for an associated augmented reality target while requesting to search for an augmented reality target.
  • the method includes: Step S1502: Moving an augmented reality client
  • the end generates an augmented reality target according to the acquired augmented reality terminal context (for example: latitude and longitude) or an alternative augmented reality target feature (for example: image feature descriptor)
  • the cable parameter sends an augmented reality target search request to the mobile augmented reality server.
  • the "Augmented Augmented Reality Target Search Indicator" and "Associated Augmented Reality Target Search Relationship" are added to the augmented reality target search request.
  • Step S1504 The mobile augmented reality server extracts the search parameters carried in the augmented reality target search request, constructs the query condition, searches for the augmented reality target information storage based on the relational POI, and returns the matching relationship information including the associated augmented reality target.
  • Augmented reality target information is included;
  • Step S1508 S1510 The mobile augmented reality server queries the augmented reality personalization and context, including: associated augmented reality target search preference setting, augmented reality content/target filtering preference setting, etc.;
  • Step S1512 S1514 According to the search The "associated augmented reality target search indicator" in the request, or the augmented reality personalization and the associated augmented reality target search preference setting in the context, the relationship property of the augmented reality target information obtained by the mobile augmented reality server according to the foregoing search matching, for example : “contains” relationship, “contained” relationship, "adjacent” relationship, further searches for other augmented reality targets that have not yet been associated;
  • Step S1516 S1518 Mobile augmented reality server requests augmented reality content server acquisition Searching for the augmented reality content corresponding to the augmented reality target;
  • Step S1520 The mobile augmented reality server performs augmented reality content/target filtering according to the augmented reality content/target filtering preference setting, and returns the mobile augmented reality
  • the present invention also provides an embodiment of a specific relationship-based point of interest mobile augmented reality method for searching for an associated augmented reality object while acquiring the augmented reality content.
  • the method includes: Step S1602: The mobile augmented reality client generates an augmented reality content acquisition parameter according to the user interaction request, and sends an augmented reality content acquisition request to the mobile augmented reality server.
  • Step S1604 S1606 the mobile augmented reality server extracts the acquisition parameter carried in the augmented reality content acquisition request, And requesting the augmented reality content server to obtain the corresponding augmented reality content;
  • Step S1608 S1610: the mobile augmented reality server queries the augmented reality personalization and the context, including: the associated augmented reality target search preference setting, the augmented reality content/target filtering preference setting, and the like;
  • Step S1612 S1614 according to the “associated augmented reality target search indicator” in the acquisition request, or the augmented reality personalization and the associated augmented reality target search preference setting in the context, the mobile augmented reality server according to the relationship attribute in the corresponding augmented reality target information, for example : “contains" relationship, "contained” relationship, "adjacent” relationship, further searches for associated augmented reality goals;
  • step S1616 Mobile augmented reality server performs augmented reality according to augmented reality
  • the present invention also provides an embodiment of a specific relationship-based point of interest mobile augmented reality method for requesting search for an associated augmented reality target.
  • the method includes: Step S1702: The mobile augmented reality client is obtained according to the acquisition. Augmented reality terminal context (eg: latitude and longitude) or alternative augmented reality target feature (eg: image feature descriptor), generating an augmented reality target search parameter, and transmitting an augmented reality target search request to the mobile augmented reality server; Step S1704: S1706: Mobile enhancement
  • the real server extracts the search parameters carried in the augmented reality target search request, constructs the query condition, searches for the augmented reality target information storage based on the relational POI, and returns the matched matching information including the relationship information between the associated augmented reality targets.
  • Step S1708 S1710 The mobile augmented reality server queries the augmented reality personalization and context, including: associated augmented reality target search preference setting, augmented reality content/target filtering preference setting, etc.;
  • the association relationships mentioned in the foregoing embodiments of the present invention mainly include: a geographical relationship relationship, including: an inclusion relationship, an included relationship, an adjacent relationship, and the like.
  • a geographical relationship relationship including: an inclusion relationship, an included relationship, an adjacent relationship, and the like.
  • the above-mentioned geographical relationship is described by taking the relationship between the point of interest A and the point of interest B as an example. Specifically: "Contains" relationship, indicating that a point of interest (for example: POI A) contains another point of interest (for example: POI B);
  • A point of interest
  • POI B point of interest
  • Logical affiliation including: father relationship, child relationship, similar relationship, etc.
  • the above logical membership relationship is described by taking the relationship between the point of interest A and the point of interest B as an example. specific:
  • Similar with relationship indicating that a point of interest (category, type, price) is similar to another point of interest (POI B); time dimension association, including: historical relationship, Future relationships, etc.
  • time dimension association including: historical relationship, Future relationships, etc.
  • the "Future" relationship indicates that a point of interest (POI A) in the time dimension is a point of interest for another point of interest (POI B) at some point in the future. From the above description, it can be seen that the present invention achieves the following technical effects:
  • the present invention provides a mobile augmented reality method and system based on a relationship-type point of interest (P0I), which can not only enhance the image search according to the current location of the user or the terminal.
  • the realistic goal is also to return the augmented reality point of interest (P0I) to the user in conjunction with the association between nearby deployment targets.
  • the user can know the relationship information between the search and the augmented reality point of interest (P0I), which facilitates subsequent access operations of the P0I, such as: proximity access, parent-child access, similar access, etc.; on the other hand, the user can know the search range in advance.
  • Augmented Reality Interest Points (P0I) avoid missing other augmented reality information of interest.
  • the mobile augmented reality server performs the search of the associated augmented reality target according to the augmented reality target search request or the indication information of the search-associated augmented reality target carried in the augmented reality content acquisition request, and solves the problem in the prior art only for the request
  • the problem of incomplete search results caused by the search of the object achieves a more comprehensive technical effect of the information searched in the augmented reality application, so that the user can obtain more comprehensive augmented reality information and improve the user of the augmented reality application.
  • the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across multiple computing devices.
  • the computing device may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from this
  • the steps shown or described are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)
  • Processing Or Creating Images (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明公开了移动增强现实搜索方法、客户端、服务器及搜索系统，其中，该方法包括：移动增强现实服务器接收移动增强现实客户端发送的增强现实目标搜索请求；移动增强现实服务器根据增强现实目标搜索请求中携带的搜索参数，搜索需要被识别并返回的增强现实目标；移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实目标；移动增强现实服务器将搜索到的增强现实目标的信息返回移动增强现实客户端。本发明解决了现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的问题，达到了增强现实应用中搜索到的信息更为全面的技术效果，使得用户可以获取更为全面的增强现实信息，提高了增强现实应用的用户体验。

Description

移动增强现实搜索方法、 客户端、 服务器及搜索系统 技术领域 本发明涉及通信领域， 具体而言， 涉及移动增强现实搜索方法、 客户端、 服务器 及搜索系统。 背景技术 随着智能终端、 移动互联网技术的成熟与发展， 曾经局限于实验室的增强现实 (Augmented Reality, 简称为 AR)技术开始走进大众视野。 一大批以图像识别、 终端 定位技术为基础的互联网 /移动互联网 AR应用开始涌现， 称为移动增强现实 （Mobile AR, 简称为 MobAR) 应用， 这引起了业界较大关注， 成为技术研究热点。 移动增强现实技术的研究与应用， 将虚拟的增强现实信息应用到真实世界， 改变 了用户观察周围世界的方式一由传统的基于文本输入的 WEB页面浏览查询模式， 转变为基于摄像头拍摄， 捕获热点并实时浏览增强信息的全新模式。
MobAR用户利用移动终端（例如， 智能手机）在拍摄周围景物的同时可以得到增 强现实业务体验。 存在如下业务场景： 移动终端上运行的增强现实应用 （AR Application)基于用户当前位置捕获 AR业务提供商部署的增强现实目标（AR Target), 例如：与地理位置相关兴趣点（POI)，并根据用户选择获取增强现实内容 (AR Content), 增强现实内容包括： 文字、 图片、 语音以及视频等。 最终结合用户终端的地理指纹信 息 （例如： 经纬度、 朝向等） 将获取的增强现实内容与终端摄像头实时拍摄的周围实 景在屏幕上进行融合显示， 获取不同寻常的增强现实业务体验。 MobAR用户在使用增强现实业务时，有时希望能够连续访问相关联的增强现实信 息， 例如： 用户在购物时， 希望通过比较同类增强现实内容决定最终如何购买， 此处 的增强现实内容主要是服务说明或者产品广告等。 然而， 现有的增强现实应用仅仅根 据用户位置或者当前摄像头捕获实景来搜索兴趣点， 即如果某个兴趣点进入用户预设 的搜索范围或被摄像头捕获到， 则该兴趣点将被搜索并返回相关的增强现实内容， 否 则用户不会知道该兴趣点的存在， 也就无法获取相关的增强现实内容。 上述处理方式存在一定的弊端， 首先， 容易导致用户错过某些感兴趣的热点， 却 没有得到任何的提示； 其次， 由于是基于增强现实目标本身进行的搜索， 没有相应的 扩展搜索， 而导致用户获取的增强现实信息不全面， 无法满足增强现实业务的需求。 针对上述的问题， 目前尚未提出有效的解决方案。 发明内容 本发明提供了移动增强现实搜索方法、 客户端、 服务器及搜索系统， 以至少解决 现有技术中由于基于增强现实目标本身进行的搜索而导致用户获取的增强现实信息不 全面的技术问题。 根据本发明的一个方面， 提供了一种移动增强现实搜索方法， 包括： 移动增强现 实服务器接收移动增强现实客户端发送的增强现实目标搜索请求； 移动增强现实服务 器根据增强现实目标搜索请求中携带的搜索参数， 搜索需要被识别并返回的增强现实 目标； 移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实目标； 移动增强现实服务器将搜索到的增强现实目标的信息返回移动增强现实客户端。 优选地， 移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实 目标的步骤包括： 移动增强现实服务器根据搜索参数中的第一指示符， 确定增强现实 目标关联关系； 移动增强现实服务器搜索与已搜索到的增强现实目标之间具有增强现 实目标关联关系的增强现实目标。 优选地， 增强现实目标关联关系包括以下至少之一： 包含关系、 被包含关系、 相 邻关系。 优选地， 增强现实目标关联关系包括以下至少之一： 父亲关系、 孩子关系、 历史 关系、 未来关系。 优选地， 移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实 目标的步骤包括： 移动增强现实服务器判断搜索参数中是否存在第二指示符， 其中， 第二指示符用于指示对与已搜索到的增强现实目标相关联的增强现实目标进行搜索； 若存在第二指示符， 则移动增强现实服务器进一步搜索与已搜索到的增强现实目标相 关联的增强现实目标。 优选地， 在移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现 实目标之后， 该移动增强现实搜索方法还包括： 移动增强现实服务器判断搜索参数中 是否存在第三指示符， 其中， 第三指示符用于指示搜索与已搜索到的增强现实目标相 关联的增强现实目标对应的增强现实内容； 若存在第三指示符， 则移动增强现实服务 器搜索与已搜索到的增强现实目标相关联的增强现实目标对应的增强现实内容。 根据本发明的另一个方面， 提供了另一种移动增强现实搜索方法， 包括： 移动增 强现实服务器接收移动增强现实客户端发送的增强现实内容获取请求； 移动增强现实 服务器根据增强现实内容获取请求中携带的参数， 搜索需要被获取并返回的增强现实 内容； 移动增强现实服务器搜索与获取的增强现实内容对应的增强现实目标相关联的 增强现实目标； 移动增强现实服务器将获取的增强现实内容以及与获取的增强现实内 容对应的增强现实目标相关联的增强现实目标的信息返回移动增强现实客户端。 优选地， 移动增强现实服务器搜索与增强现实内容对应的增强现实目标相关联的 增强现实目标的步骤包括： 移动增强现实服务器根据参数中的第一指示符， 确定增强 现实目标关联关系； 移动增强现实服务器搜索与获取的增强现实内容对应的增强现实 目标之间具有增强现实目标关联关系的增强现实目标。 优选地， 增强现实目标关联关系包括以下至少之一： 父亲关系、 孩子关系、 历史 关系、 未来关系。 优选地， 移动增强现实服务器搜索与增强现实内容对应的增强现实目标相关联的 增强现实目标的步骤包括： 移动增强现实服务器判断参数中是否存在第二指示符， 其 中， 第二指示符用于指示对与获取的增强现实内容对应增强现实目标相关联的增强现 实目标进行搜索； 若存在第二指示符， 则移动增强现实服务器进一步搜索与获取的增 强现实内容对应的增强现实目标相关联的增强现实目标。 优选地， 在移动增强现实服务器搜索与增强现实内容对应的增强现实目标相关联 的增强现实目标之后， 该方法还包括： 移动增强现实服务器判断参数中是否存在第三 指示符， 其中， 第三指示符用于指示是否获取与获取的增强现实内容对应的增强现实 目标相关联的增强现实目标对应的增强现实内容； 若存在第三指示符， 则移动增强现 实服务器搜索与获取的增强现实内容对应的增强现实目标相关联的增强现实目标对应 的增强现实内容。 根据本发明的又一个方面， 提供了又一种移动增强现实搜索方法， 包括： 移动增 强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索请求中提供搜索参 数， 其中， 搜索参数用于请求移动增强现实服务器搜索增强现实目标， 以及搜索与增 强现实目标相关联的增强现实目标； 移动增强现实客户端发送增强现实目标搜索请求 至移动增强现实服务器。 优选地，移动增强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索 请求中提供搜索参数的步骤包括：移动增强现实客户端在搜索参数中添加第一指示符， 其中， 第一指示符用于指示增强现实目标关联关系， 以请求移动增强现实服务器搜索 与增强现实目标具有增强现实目标关联关系的增强现实目标。 优选地， 增强现实目标关联关系包括以下至少之一： 包含关系、 被包含关系、 相 邻关系、 父亲关系、 孩子关系、 历史关系、 未来关系。 优选地，移动增强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索 请求中提供搜索参数的步骤包括：移动增强现实客户端在搜索参数中添加第二指示符， 其中， 第二指示符用于指示对与增强现实目标相关联的增强现实目标进行搜索。 优选地，移动增强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索 请求中提供搜索参数的步骤包括：移动增强现实客户端在搜索参数中携带第三指示符， 其中， 第三指示符用于指示移动增强现实服务器搜索与需要被识别并返回的增强现实 目标相关联的增强现实目标对应的增强现实内容。 根据本发明的又一个方面， 提供了又一种移动增强现实搜索方法， 包括： 移动增 强现实客户端在增强现实内容获取请求中提供参数， 其中， 参数用于请求移动增强现 实服务器获取增强现实内容， 以及搜索与获取的增强现实内容对应的增强现实目标相 关联的增强现实目标； 移动增强现实客户端发送增强现实内容获取请求至移动增强现 实服务器。 优选地， 移动增强现实客户端在增强现实内容获取请求中提供参数的步骤包括： 移动增强现实客户端在参数中添加第一指示符， 其中， 第一指示符用于指示增强现实 目标关联关系， 以请求移动增强现实服务器搜索与获取的增强现实内容对应的增强现 实目标相关联的增强现实目标。 优选地， 增强现实目标关联关系包括以下至少之一： 包含关系、 被包含关系、 相 邻关系、 父亲关系、 孩子关系、 历史关系、 未来关系。 优选地， 移动增强现实客户端在增强现实内容获取请求中提供参数的步骤包括： 移动增强现实客户端在参数中添加第二指示符， 其中， 第二指示符用于指示对与获取 的增强现实内容对应的增强现实目标相关联的增强现实目标进行搜索。 优选地， 移动增强现实客户端在增强现实内容获取请求中提供参数的步骤包括： 移动增强现实客户端在参数中携带第三指示符， 其中， 第三指示符用于指示移动增强 现实服务器获取与获取的增强现实内容对应增强现实目标相关联的增强现实目标对应 的增强现实内容。 根据本发明的又一个方面， 提供了又一种移动增强现实搜索方法， 包括： 移动增 强现实客户端接收移动增强现实服务器返回的增强现实目标搜索响应； 移动增强现实 客户端提取增强现实目标搜索响应中携带的增强现实目标的信息； 移动增强现实客户 端根据增强现实目标的信息显示增强现实目标之间的关联关系。 优选地， 移动增强现实客户端显示增强现实目标之间关联关系的步骤包括： 移动 增强现实客户端显示搜索范围之内所有增强现实目标之间的关联关系； 或者， 移动增 强现实客户端显示一个增强现实目标所对应的关联关系。 优选地， 关联关系包括以下至少之一： 包含关系、 被包含关系、 相邻关系、 父亲 关系、 孩子关系、 历史关系、 未来关系。 根据本发明的又一个方面， 提供了一种移动增强现实服务器， 包括： 接收单元， 设置为接收移动增强现实客户端发送的增强现实目标搜索请求； 第一搜索单元， 设置 为根据增强现实目标搜索请求中携带的搜索参数， 搜索需要被识别并返回的增强现实 目标； 第二搜索单元， 设置为搜索与已搜索到的增强现实目标相关联的增强现实目标; 返回单元， 设置为将搜索到的增强现实目标的信息返回移动增强现实客户端。 根据本发明的又一个方面， 提供了另一种移动增强现实服务器， 包括： 接收单元， 设置为接收移动增强现实客户端发送的增强现实内容获取请求； 第一搜索单元， 设置 为根据增强现实内容获取请求中携带的参数，搜索需要被获取并返回的增强现实内容; 第二搜索单元， 设置为搜索与获取的增强现实内容对应的增强现实目标相关联的增强 现实目标； 返回单元， 设置为将获取的增强现实内容以及与获取的增强现实内容对应 的增强现实目标相关联的增强现实目标的信息返回移动增强现实客户端。 根据本发明的又一个方面， 提供了一种移动增强现实客户端， 包括： 提供单元， 设置为根据用户上下文和 /或用户偏好在增强现实目标搜索请求中提供搜索参数， 其 中， 搜索参数用于请求移动增强现实服务器搜索增强现实目标以及与增强现实目标相 关联的增强现实目标； 发送单元， 设置为发送增强现实目标搜索请求至移动增强现实 服务器。 根据本发明的又一个方面， 提供了另一种移动增强现实客户端， 包括： 提供单元， 设置为在增强现实内容获取请求中提供参数， 其中， 参数用于请求移动增强现实服务 器获取增强现实内容， 以及搜索与获取的增强现实内容对应的增强现实目标相关联的 增强现实目标； 发送单元， 设置为发送增强现实内容获取请求至移动增强现实服务器。 根据本发明的又一个方面， 提供了另一种移动增强现实客户端， 包括： 接收单元， 设置为接收移动增强现实服务器返回的增强现实目标搜索响应； 提取单元， 设置为提 取增强现实目标搜索响应中携带的增强现实目标的信息； 显示单元， 设置为根据增强 现实目标的信息显示增强现实目标之间的关联关系。 根据本发明的又一个方面， 提供了一种移动增强现实搜索系统， 包括上述的移动 增强现实服务器和上述的移动增强现实客户端。 在本发明中， 移动增强现实服务器根据增强现实目标搜索请求或增强现实内容获 取请求中携带的搜索相关联的增强现实目标的指示信息进行相关联的增强现实目标的 搜索， 解决了现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的 问题， 达到了增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获取 更为全面的增强现实信息， 提高了增强现实应用的用户体验。 附图说明 此处所说明的附图用来提供对本发明的进一步理解， 构成本申请的一部分， 本发 明的示意性实施例及其说明用于解释本发明， 并不构成对本发明的不当限定。 在附图 中： 图 1是根据本发明实施例的移动增强现实搜索方法的一种优选流程图； 图 2是根据本发明实施例的移动增强现实搜索方法的另一种优选流程图； 图 3是根据本发明实施例的移动增强现实搜索方法的又一种优选流程图； 图 4是根据本发明实施例的移动增强现实搜索系统的一种优选结构框图； 图 5是根据本发明实施例的移动增强现实搜索装置的另一种优选结构框图; 图 6是根据本发明实施例的移动增强现实搜索方法的又一种优选流程图； 图 7是根据本发明实施例的移动增强现实搜索方法的又一种优选流程图； 图 8是根据本发明实施例的移动增强现实搜索装置的又一种优选结构框图; 图 9是根据本发明实施例的基于关系型兴趣点移动增强现实系统架构的一种结构 示意图； 图 10 是根据本发明实施例的基于关系型兴趣点移动增强现实系统架构的另一种 结构示意图； 图 11 是根据本发明实施例的基于关系型兴趣点移动增强现实系统架构的又一种 结构示意图； 图 12 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的一种优选流程图； 图 13 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的一种优选流程图； 图 14 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的另一种优选流程图； 图 15 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的交互示意图； 图 16 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的另一交互示意图； 图 17 是根据本发明实施例的基于关系型兴趣点移动增强现实服务器业务请求的 搜索方法的又一交互示意图。 具体实施方式 下文中将参考附图并结合实施例来详细说明本发明。 需要说明的是， 在不冲突的 情况下， 本申请中的实施例及实施例中的特征可以相互组合。 实施例 1 本发明实施例提供了一种优选的移动增强现实搜索方法， 该方法主要是基于增强 现实目标搜索请求进行的， 如图 1所示， 该方法具体步骤包括：
S102:移动增强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索请 求中提供搜索参数，其中，搜索参数用于请求移动增强现实服务器搜索增强现实目标， 以及搜索与增强现实目标相关联的增强现实目标；
S104: 移动增强现实客户端发送增强现实目标搜索请求至移动增强现实服务器。 在上述优选实施方式中， 移动增强现实客户端在生成的增强现实目标搜索请求中 增加搜索相关联的增强现实目标的指示信息， 实现了相关联的增强现实目标搜索， 解 决了现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的问题， 达 到了增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获取更为全面 的增强现实信息， 提高了增强现实应用的用户体验。 上述的用户上下文即， 用户的状态， 它可以包括但不限于用户地理位置和 /或用户 呈现信息。 在一个优选实施方式中， 移动增强现实客户端可以按照如下方式根据用户上下文 和 /或用户偏好在增强现实目标搜索请求中提供搜索参数： 移动增强现实客户端在搜索 参数中添加第一指示符， 其中， 第一指示符用于指示增强现实目标关联关系， 以请求 移动增强现实服务器搜索与增强现实目标具有增强现实目标关联关系的增强现实目 标。 其中， 该增强现实目标关联关系包括但不限于以下至少之一： 包含关系、 被包含 关系、 相邻关系、 父亲关系、 孩子关系、 历史关系及未来关系。 该第一指示符可以是 "相关联增强现实目标搜索关系" 的搜索参数值。 移动增强现实客户端还可以根据用户上下文和 /或用户偏好在搜索参数中添加别 的指示信息， 在一个优选实施方式中， 移动增强现实客户端在搜索参数中添加第二指 示符，其中，第二指示符用于指示对与增强现实目标相关联的增强现实目标进行搜索。 其中， 第二指示符可以是 "相关联增强现实目标搜索指示符"。 在一个优选实施方式中，移动增强现实客户端根据用户上下文和 /或用户偏好在增 强现实目标搜索请求中提供搜索参数的步骤包括： 移动增强现实客户端在搜索参数中 携带第三指示符， 其中， 第三指示符用于指示移动增强现实服务器搜索与需要被识别 并返回的增强现实目标相关联的增强现实目标对应的增强现实内容。 其中， 该第三指 示符可以是 "增强现实内容缓存指示符"。 在步骤 S104以后，移动增强现实服务器基于该增强现实目标搜索请求进行增强现 实目标的搜索， 本发明实施例提供了一种具体的搜索的方法， 如图 2所示， 包括：
S202: 移动增强现实服务器接收移动增强现实客户端发送的增强现实目标搜索请 求；
S204: 移动增强现实服务器根据增强现实目标搜索请求中携带的搜索参数， 搜索 需要被识别并返回的增强现实目标； S206: 移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实目 标；
S208: 移动增强现实服务器将搜索到的增强现实目标的信息返回给移动增强现实 客户端。 在上述优选实施方式中， 移动增强现实服务器根据增强现实目标搜索请求中携带 的搜索相关联的增强现实目标的指示信息进行相关联的增强现实目标的搜索， 解决了 现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的问题， 达到了 增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获取更为全面的增 强现实信息， 提高了增强现实应用的用户体验。 在一个优选实施方式中， 移动增强现实服务器可以按照以下方式搜索与已搜索到 的增强现实目标相关联的增强现实目标： 移动增强现实服务器根据搜索参数中的第一 指示符， 确定增强现实目标关联关系； 移动增强现实服务器搜索与已搜索到的增强现 实目标之间具有增强现实目标关联关系的增强现实目标。 其中， 该增强现实目标关联 关系包括但不限于以下至少之一： 包含关系、 被包含关系、 相邻关系、 父亲关系、 孩 子关系、 历史关系及未来关系。 在一个优选实施方式中， 移动增强现实服务器可以按照如下方式搜索与已搜索到 的增强现实目标相关联的增强现实目标： 移动增强现实服务器判断搜索参数中是否存 在第二指示符， 其中， 该第二指示符用于指示对与已搜索到的增强现实目标相关联的 增强现实目标进行搜索； 若存在第二指示符， 则移动增强现实服务器进一步搜索与已 搜索到的增强现实目标相关联的增强现实目标。 即， 如果搜索参数中携带有第二指示 符（该第二指示符可以是相关联增强现实目标搜索指示符）， 则对与已搜索到的增强现 实目标相关联的增强现实目标进行搜索， 否则不进行关联的目标搜索。 在一个优选实施方式中， 在移动增强现实服务器搜索与已搜索到的增强现实目标 相关联的增强现实目标之后， 该移动增强现实搜索方法还包括： 移动增强现实服务器 判断搜索参数中是否存在第三指示符， 其中， 该第三指示符用于指示搜索与已搜索到 的增强现实目标相关联的增强现实目标对应的增强现实内容； 若存在第三指示符， 则 移动增强现实服务器搜索与已搜索到的增强现实目标相关联的增强现实目标对应的增 强现实内容。 即， 如果搜索参数中携带有第三指示符 （该第三指示符可以是增强现实 内容缓存指示符），则对与已搜索到的增强现实目标相关联的增强现实目标对应的增强 现实内容进行搜索， 否则不进行相关联的内容搜索。 在步骤 S208之后，需要对搜索到的信息进行展示，本发明实施例还提供了一种增 强现实的展示方法， 如图 3所示， 具体步骤包括：
S302: 移动增强现实客户端接收移动增强现实服务器返回的增强现实目标搜索响 应； S304: 移动增强现实客户端提取增强现实目标搜索响应中携带的增强现实目标的 信息；
S306: 移动增强现实客户端根据增强现实目标的信息显示增强现实目标之间的关 联关系。 在一个优选实施方式中， 对于移动增强现实客户端显示增强现实目标之间关联关 系可以采用以下两种方式：
1 )移动增强现实客户端显示搜索范围之内所有增强现实目标之间的关联关系； 或 者，
2) 移动增强现实客户端显示一个增强现实目标所对应的关联关系。 上述的关联关系包括但不限于以下至少之一： 包含关系、被包含关系、相邻关系、 父亲关系、 孩子关系、 历史关系以及未来关系。 本发明实施例提供了一种优选的移动增强现实搜索系统， 如图 4所示， 包括： 移 动增强现实服务器 402和移动增强现实客户端 404。 其中， 该移动增强现实服务器 402包括： 第一接收单元 4022， 设置为接收移动增 强现实客户端发送的增强现实目标搜索请求； 第一搜索单元 4024， 与第一接收单元 4022耦合， 设置为根据增强现实目标搜索请求中携带的搜索参数， 搜索需要被识别并 返回的增强现实目标； 第二搜索单元 4026， 与第一搜索单元 4024耦合， 设置为搜索 与已搜索到的增强现实目标相关联的增强现实目标； 第一返回单元 4028， 与第二搜索 单元 4026耦合， 设置为将搜索到的增强现实目标的信息返回移动增强现实客户端。 该移动增强现实客户端 404包括： 第一提供单元 4042， 设置为根据用户上下文和 /或用户偏好在增强现实目标搜索请求中提供搜索参数， 其中， 搜索参数用于请求移动 增强现实服务器搜索增强现实目标以及与增强现实目标相关联的增强现实目标； 第一 发送单元 4044， 与第一提供单元 4042耦合， 设置为发送增强现实目标搜索请求至移 动增强现实服务器。 在一个优选实施方式中， 如图 5所示， 移动增强现实客户端 404还可以包括： 第 二接收单元 502， 设置为接收移动增强现实服务器返回的增强现实目标搜索响应； 提 取单元 504， 与第二接收单元 502耦合， 设置为提取增强现实目标搜索响应中携带的 增强现实目标的信息； 显示单元 506， 与提取单元 504耦合， 设置为根据增强现实目 标的信息显示增强现实目标之间的关联关系。 优选的， 图 4和图 5中的增强现实搜索系统实现增强现实搜索方法的具体执行步 骤可以如上述各个优选实施方式所描述的， 在此不再赘述。 实施例 2 本发明实施例还提供了一种优选的移动增强现实搜索方法， 该方法主要是基于增 强现实内容获取请求进行的， 如图 6所示， 该方法具体步骤包括：
S602: 移动增强现实客户端在增强现实内容获取请求中提供参数， 其中， 参数用 于请求移动增强现实服务器获取增强现实内容， 以及搜索与获取的增强现实内容对应 的增强现实目标相关联的增强现实目标；
S604: 移动增强现实客户端发送增强现实内容获取请求至移动增强现实服务器。 在上述优选实施方式中， 移动增强现实客户端在生成的增强现实内容获取请求中 增加搜索相关联的增强现实目标的指示信息， 实现了相关联的增强现实目标及其内容 的搜索， 解决了现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面 的问题， 达到了增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获 取更为全面的增强现实信息， 提高了增强现实应用的用户体验。 在一个优选实施方式中， 移动增强现实客户端可以按照如下方式在增强现实内容 获取请求中提供参数： 移动增强现实客户端在参数中添加第一指示符， 其中， 第一指 示符用于指示增强现实目标关联关系， 以请求移动增强现实服务器搜索与获取的增强 现实内容对应的增强现实目标相关联的增强现实目标。 其中， 该增强现实目标关联关 系包括但不限于以下至少之一： 包含关系、 被包含关系、 相邻关系、 父亲关系、 孩子 关系、 历史关系及未来关系。 该第一指示符可以是 "相关联增强现实目标搜索关系" 的参数值。 移动增强现实客户端还可以在参数中添加别的指示信息，在一个优选实施方式中， 移动增强现实客户端在参数中添加第二指示符， 其中， 第二指示符用于指示对与获取 的增强现实内容对应的增强现实目标相关联的增强现实目标进行搜索。 优选的， 该第 二指示符可以是 "相关联增强现实目标搜索指示符"。 在一个优选实施方式中， 移动增强现实客户端在增强现实内容获取请求中提供参 数的步骤包括： 移动增强现实客户端在参数中携带第三指示符， 其中， 第三指示符用 于指示移动增强现实服务器获取与获取的增强现实内容对应增强现实目标相关联的增 强现实目标对应的增强现实内容。 优选的， 该第三指示符可以是 "增强现实内容缓存 指示符"。 在步骤 S604之后，移动增强现实服务器基于该增强现实内容获取请求进行增强现 实目标和内容的搜索， 具体的搜索过程， 如图 7所示， 包括： S702: 移动增强现实服务器接收移动增强现实客户端发送的增强现实内容获取请 求；
S704: 移动增强现实服务器根据增强现实内容获取请求中携带的参数， 搜索需要 被获取并返回的增强现实内容；
S706: 移动增强现实服务器搜索与获取的增强现实内容对应的增强现实目标相关 联的增强现实目标；
S708: 移动增强现实服务器将获取的增强现实内容以及与获取的增强现实内容对 应的增强现实目标相关联的增强现实目标的信息返回移动增强现实客户端。 在上述优选实施方式中， 移动增强现实服务器根据增强现实内容获取请求中携带 的搜索相关联的增强现实目标的指示信息进行相关联的增强现实目标及其内容的搜 索， 解决了现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的问 题， 达到了增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获取更 为全面的增强现实信息， 提高了增强现实应用的用户体验。 在一个优选实施方式中， 移动增强现实服务器可以按照如下方式搜索与增强现实 内容对应的增强现实目标相关联的增强现实目标： 移动增强现实服务器根据参数中的 第一指示符， 确定增强现实目标关联关系； 移动增强现实服务器搜索与获取的增强现 实内容对应的增强现实目标之间具有增强现实目标关联关系的增强现实目标。 其中， 该增强现实目标关联关系包括但不限于以下至少之一： 包含关系、 被包含关系、 相邻 关系、 父亲关系、 孩子关系、 历史关系及未来关系。 在一个优选实施方式中， 移动增强现实服务器可以按照如下方式搜索与增强现实 内容对应的增强现实目标相关联的增强现实目标： 移动增强现实服务器判断参数中是 否存在第二指示符， 其中， 该第二指示符用于指示对与获取的增强现实内容对应增强 现实目标相关联的增强现实目标进行搜索； 若存在第二指示符， 则移动增强现实服务 器进一步搜索与获取的增强现实内容对应的增强现实目标相关联的增强现实目标。即， 如果参数中携带有第二指示符 （该第二指示符可以是相关联增强现实目标搜索指示 符）， 则对与获取的增强现实内容对应的增强现实目标相关联的增强现实目标进行搜 索， 否则不进行关联的目标搜索。 在一个优选实施方式中， 在移动增强现实服务器搜索与增强现实内容对应的增强 现实目标相关联的增强现实目标之后， 该方法还包括： 移动增强现实服务器判断参数 中是否存在第三指示符， 其中， 该第三指示符用于指示获取与获取的增强现实内容对 应的增强现实目标相关联的增强现实目标对应的增强现实内容； 若存在第三指示符， 则移动增强现实服务器搜索与获取的增强现实内容对应的增强现实目标相关联的增强 现实目标对应的增强现实内容。 即， 如果参数中携带有第三指示符 （该第三指示符可 以是增强现实内容缓存指示符），则对与获取的增强现实内容对应的增强现实目标相关 联的增强现实目标对应的增强现实内容进行搜索， 否则不进行相关联的内容搜索。 本发明实施例还提供了一种优选的增强现实搜索系统， 如图 8所示， 该系统包括: 移动增强现实服务器 802和移动增强现实客户端 804， 其中， 该移动增强现实服务器 802包括： 第三接收单元 8022， 设置为接收移动增强现实客户端发送的增强现实内容 获取请求； 第三搜索单元 8024， 与第三接收单元 8022耦合， 设置为根据增强现实内 容获取请求中携带的参数， 搜索需要被获取并返回的增强现实内容； 第四搜索单元 8026， 与第三搜索单元 8024耦合， 设置为搜索与获取的增强现实内容对应的增强现实 目标相关联的增强现实目标； 第二返回单元 8028， 与第四搜索单元 8026耦合， 设置 为将获取的增强现实内容以及与获取的增强现实内容对应的增强现实目标相关联的增 强现实目标的信息返回移动增强现实客户端。 该移动增强现实客户端 804可以包括： 第二提供单元 8042， 设置为在增强现实内 容获取请求中提供参数，其中， 参数用于请求移动增强现实服务器获取增强现实内容， 以及搜索与获取的增强现实内容对应的增强现实目标相关联的增强现实目标； 第二发 送单元 8044， 与第二提供单元 8042耦合， 设置为发送增强现实内容获取请求至移动 增强现实服务器。 优选的， 图 8中的增强现实搜索系统实现增强现实搜索方法的具体执行步骤可以 如上述各个优选实施方式所描述的， 在此不再赘述。 对于图 4与图 5中的增强现实搜索系统与图 8中示出的移动增强现实系统可以同 时存在也可以单独存在， 本发明对此不做限定。 实施例 3 本发明提供了一种优选的实施例来进一步对本发明进行解释，但是值得注意的是， 该优选实施例只是为了更好的描述本发明， 并不构成对本发明不当的限定。 本发明提出的一种基于关系型兴趣点 （Point of Interest, 简称为 P0I)移动增强现 实系统架构， 如图 9所示， 包括： 移动增强现实服务器 100、 增强现实内容服务器 200、 通信网络 300、 移动增强现 实终端 400和移动增强现实客户端 500。 其中， 移动增强现实服务器 100是移动增强现实系统网络侧的功能实体， 负责根 据移动增强现实客户端 500请求， 及用户增强现实个性化及上下文设置， 搜索增强现 实目标、 选择并获取增强现实内容， 如图 10所示， 主要包括以下功能实体： 增强现实内容 /目标选择功能 110， 设置为在移动增强现实服务器 100中根据接收 的移动增强现实客户端 500请求， 或者与增强现实目标和 /或增强现实内容递送相关推 送请求， 搜索增强现实目标， 选择并获取增强现实内容。 增强现实目标搜索单元 111， 设置为根据增强现实目标搜索请求携带的增强现实 目标搜索参数， 以及增强现实个性化及上下文， 构造增强现实目标搜索条件， 并向增 强现实内容 /目标管理功能 120发送增强现实目标搜索请求， 获取符合条件的增强现实 目标， 其中， 上述增强现实目标搜索参数， 可以包括但不限于以下至少之一： 增强现用户位置信息， 例如： 经纬度； 增强现实目标搜索半径、 搜索类别； 增强现实目标类型， 例如： POI (兴趣点）； 增强现实目标特征， 例如： 开放时间、 价格区间； 相关联增强现实目标搜索指示符； 相关联增强现实目标搜索关系， 搜索关系包括： "包含"关系、 "被包含"关系、
"相邻"关系等； 增强现实内容缓存指示符， 例如： 缓存、 不缓存。 上述的 "相关联增强现实目标搜索指示符"用于指示同时搜索与已匹配增强现实 目标相关联的其他增强现实目标。 若增强现实目标搜索请求中存在相关联增强现实目 标搜索指示符， 则增强现实内容 /目标选择功能 110根据搜索匹配返回增强现实目标信 息中的 "Relationship "关系属性， SP， 相关联增强现实目标搜索关系， 进一步搜索其 他相关联增强现实目标； 否则， 增强现实内容 /目标选择功能 110只返回搜索匹配的增 强现实目标。 上述的 "相关联增强现实目标搜索关系"用于表示搜索相关联增强现实目标时所 遵循的搜索关系依据。 用于表示搜索 "包含"关系下相关联的增强现实目标， 或者搜 索"被包含 "关系下相关联的增强现实目标， 或者搜索"相邻"关系下相关联的增强现实 目标， 优选的， 可以默认搜索所有关系下相关联的增强现实目标。 上述的 "增强现实内容缓存指示符"用于表示缓存对应的增强现实内容， 即， 若 增强现实目标搜索请求中存在强现实内容缓存指示符则获取相关联的增强现实目标的 增强现实内容。 增强现实内容获取单元 112， 设置为根据增强现实内容获取请求携带的增强现实 内容获取参数， 以及增强现实个性化及上下文， 构造增强现实内容获取条件， 向增强 现实内容 /目标管理功能 120发送增强现实内容获取请求， 获取符合条件增强现实内容 集合， 上述增强现实内容获取参数， 包括但不限于以下至少之一： 增强现实内容标识， 或相关联增强现实目标标识； 增强现实内容特征， 例如： 媒体类型、 收费价格； 相关联增强现实目标搜索指示符； 相关联增强现实目标搜索关系， 搜索关系包括： "包含"关系、 "被包含"关系、 "相邻"关系等； 增强现实内容缓存指示符， 用于表示缓存与相关联增强现实目标对应的增强现实 内容。 增强现实内容 /目标管理功能 120， 设置为增强现实目标部署、 增强现实内容发布 相关信息的存储与管理， 主要包括： 基于关系型 POI增强现实目标信息管理， 至少包括： 增强现实目标标识、 增强现 实目标类型、 分类、 描述， 对应增强现实内容标识， 相关联增强现实目标关系信息， 至少包括： "包含"关系、 "被包含"关系、 "相邻"关系； 对应增强现实内容信息管理， 至少包括： 增强现实内容标识、增强现实目标标识、 增强现实内容发布状态、 增强现实内容部署规则、 以及增强现实内容访问地址以及访 问控制策略等； 增强现实个性化及上下文功能 130， 设置为管理用户个性化偏好以及用户上下文， 其中， 用户个性化偏好包括但不限于以下至少之一： 增强现实目标搜索偏好， 例如： 搜索半径， 搜索类别、 增强现实目标特征等； 增强现实内容获取偏好， 例如： 增强现 实内容特征等； 相关联增强现实目标搜索偏好， 例如： 是否搜索相关联增强现实目标； 以及相关联增强现实目标搜索关系， 例如： "包含"关系、 "被包含"关系以及 "相邻" 关系。 用户上下文包括但不限于以下至少之一： 用户状态， 例如： 用户地理位置、 用户 呈现信息； 增强现实终端状态， 例如： 屏幕尺寸、 剩余电量、 存储空间以及媒体播放 能力等。 增强现实内容服务器 200是增强现实内容提供商部署在网络侧的功能实体， 设置 为提供与移动增强现实服务器中已发布的增强现实目标， 例如， 关系型兴趣点 POI。 相对应的增强现实内容包括： 文字、 图像、 音频以及视频等多媒体信息。 通信网络 300， 设置为在移动增强现实服务器 100和增强现实终端 400之间提供 网络通信链路的有线和无线的通信网络。 增强现实终端 400是用户使用的具备增强现实业务功能的移动终端， 设置为提供 基本的通信功能和为用户提供增强现实业务体验， 优选的， 可以包括： 摄像头 410， 设置为实时拍摄用户周围物理世界的实景信息 (Camera View；)。 有些 摄像头具备显存， 可以缓存拍摄到的实景信息； 显示屏幕 420， 设置为向用户呈现摄像头 531拍摄实景信息在增强现实内容修饰 渲染下的增强现实内容视图 （ Augmented Reality View, 简称为 AR View);
GPS模块、 指南针、 传感器等 430， 其中 GPS模块与全球卫星定位系统 （Global Position System, 简称为 GPS)卫星通讯， 实时提供终端位置信息（经纬度）。 指南针、 传感器， 用来采集用户终端状态， 其中， 上述用户终端状态可以包括但不限于： 摄像 头朝向、 与地面夹角等； 移动增强现实客户端 500是移动增强现实业务系统终端侧功能实体， 负责向移动 增强现实服务器 100发送增强现实目标搜索请求， 设置为选择并获取增强现实内容， 并向增强现实终端增强现实应用提供移动增强现实业务支撑能力， 如图 11所示， 可以 包括以下功能模块： 增强现实内容 /目标获取功能 510， 设置为接收运行在增强现实终端 300增强现实 应用的请求， 同时联系移动增强现实服务器 100请求搜索增强现实目标， 获取增强现 实内容。 在本发明中， 负责将搜索返回的包括相关联增强现实目标在内增强现实目标 信息传递给增强现实内容展示功能 520。 增强现实内容展示功能 520， 设置为根据增强现实终端 300状态， 控制所述增强 现实内容 /目标获取功能 510获取增强现实内容与摄像头 410拍摄实景在显示屏幕 420 上进行融合显示。 增强现实目标关系提取单元 521， 设置为提取增强现实内容 /目标获取功能 510传 递的增强现实目标信息中所包含的相关联增强现实目标之间关系信息， 至少包括： "包 含"、 "被包含"、 "相邻"关系。 增强现实内容展示控制单元 522， 设置为根据用户交互支持功能 530传递的增强 现实内容展示指示， 控制包括增强现实目标关系提取单元 521所提取相关联增强现实 目标之间关系信息在内的增强现实内容展示， 至少包括： 全局关联增强现实目标关系展示， 即展示所有搜索返回增强现实目标之间关系信 息； 单一关联增强现实目标关系展示， 及展示与某一个增强现实目标相关关系信息。 用户交互支持功能 530， 接收用户输入交互指令， 触发增强现实目标搜索、 增强 现实内容获取， 展示等业务逻辑。 在本发明中， 根据用户输入的增强现实内容展示交 互指令，指示增强现实内容展示功能 520执行与增强现实内容展示控制相关业务逻辑。 本发明实施例还提供了一种基于关系型兴趣点移动增强现实服务器业务请求的搜 索方法， 如图 12所示， 具体步骤包括： 步骤 S1202: 移动增强现实服务器接收移动增强现实客户端发送的增强现实业务 请求； 步骤 S1204: 移动增强现实服务器判断增强现实业务请求类别， 如果增强现实业 务请求为"增强现实目标搜索请求"，则执行步骤 S1206,如果增强现实业务请求为"增 强现实内容获取请求"， 则转而执行步骤 S1216。 步骤 S1206: 移动增强现实服务器提取搜索参数并搜索匹配增强现实目标； 步骤 S1208: 移动增强现实服务器根据增强现实目标搜索请求中 "相关联增强现 实目标搜索指示符" 的搜索参数值， 以及增强现实个性化和增强现实上下文， 判断是 否搜索相关联增强现实目标， 若增强现实目标搜索请求中携带有 "相关联增强现实目 标搜索指示符"， 则判断出需要搜索相关联增强现实目标， 执行步骤 S1210, 若增强现 实目标搜索请求中未携带 "相关联增强现实目标搜索指示符"， 则判断出不需要搜索相 关联增强现实目标， 转而执行步骤 S1214; 步骤 S1210: 移动增强现实服务器根据 "相关联增强现实目标搜索关系" 的搜索 参数值， 搜索与搜索匹配增强现实目标相关联增强现实目标； 步骤 S1212: 移动增强现实服务器返回搜索得到的增强现实目标以及相关联增强 现实目标， 结束该流程； 步骤 S1214: 移动增强现实服务器直接返回搜索得到的增强现实目标信息， 结束 该流程； 步骤 S1216: 移动增强现实服务器提取获取参数并根据获取参数获取对应的增强 现实内容； 步骤 S1218: 移动增强现实服务器根据增强现实内容获取请求中的 "相关联增强 现实目标搜索指示符 " 的搜索参数值， 以及增强现实个性化和增强现实上下文， 判断 是否需要搜索相关联增强现实目标； 若增强现实内容获取请求中携带有 "相关联增强 现实目标搜索指示符"， 则执行步骤 S1220, 若增强现实内容获取请求中未携带 "相关 联增强现实目标搜索指示符"， 则转而执行步骤 S1222。 步骤 S1220: 移动增强现实服务器直接返回获取的增强现实内容， 结束该流程； 步骤 S1222: 移动增强现实服务器根据 "相关联增强现实目标搜索关系" 的搜索 参数值， 搜索与获取增强现实内容相关联的增强现实目标； 步骤 S1224: 移动增强现实服务器根据 "增强现实内容缓存指示符" 的参数值， 及增强现实个性化及增强现实上下文， 判断是否获取与该相关联增强现实目标对应的 增强现实内容， 若增强现实内容获取请求中携带有 "增强现实内容缓存指示符"，则判 断出不获取与相关联增强现实目标对应的增强现实内容， 执行步骤 S1226, 否则， 转 而执行步骤 S1228; 步骤 S1226: 移动增强现实服务器返回获取的增强现实内容和搜索得到的相关联 增强现实目标， 结束该流程； 步骤 S1228: 移动增强现实服务器根据搜索得到的相关联增强现实目标获取对应 的增强现实内容； 步骤 S1230: 移动增强现实服务器返回获取的增强现实内容， 以及搜索得到的相 关联增强现实目标信息和对应的增强现实内容。 本发明还提供了一种基于关系型兴趣点移动增强现实客户端生成增强现实业务交 互请求的方法， 如图 13所示， 具体步骤包括： 步骤 S1302: 移动增强现实客户端接收用户增强现实业务交互请求； 步骤 S1304: 移动增强现实客户端判断增强现实业务交互请求的类别； 步骤 S1306: 对于 "增强现实目标搜索请求"， 移动增强现实客户端根据具体的交 互指示信息， 判断是否搜索相关联增强现实目标， 其中， 交互指示信息可以是： 用户 请求查看增强现实目标之间关系信息， 或者用户偏好设置等， 若判断出搜索相关联增 强现实目标， 则执行步骤 S1308, 否则， 转而执行步骤 S1310; 步骤 S1308: 移动增强现实客户端在增强现实业务交互请求中添加 "相关联增强 现实目标搜索指示符"， 并设置 "相关联增强现实目标搜索关系"的搜索参数值， 从而 生成增强现实目标搜索请求， 并将该增强现实目标请求发送给移动增强现实服务器， 结束该流程； 步骤 S1310: 移动增强现实客户端在增强现实业务交互请求中不添加 "相关联增 强现实目标搜索指示符"， 生成增强现实目标搜索请求，将该增强现实目标请求发送给 移动增强现实服务器， 结束该流程； 步骤 S1312: 对于 "增强现实内容获取请求"， 移动增强现实客户端根据用户偏好 设置， 判断是否搜索相关联增强现实目标， 若判断出搜索相关联增强现实目标， 则执 行步骤 S1314, 否则， 转而执行步骤 S1320; 步骤 S1314: 移动增强现实客户端进一步判断是否同时获取与相关联增强现实目 标对应的增强现实内容， 若判断出需要同时获取与相关联增强现实目标对应的增强现 实内容， 则执行步骤 S1316, 否则， 转而执行步骤 S1318; 步骤 S1316: 移动增强现实客户端添加 "相关联增强现实目标搜索指示符" 以及 "增强现实内容获取指示符"， 从而生成增强现实内容获取请求， 并将该增强现实内容 获取请求发送给移动增强现实服务器， 结束该流程； 步骤 S1318: 移动增强现实客户端添加 "相关联增强现实目标搜索指示符"， 从而 生成增强现实内容获取请求， 并将该增强现实内容获取请求发送给移动增强现实服务 器， 结束该流程； 步骤 S1320: 移动增强现实客户端不添加 "相关联增强现实目标搜索指示符"， 生 成增强现实内容获取请求，并将该增强现实内容获取请求发送给移动增强现实服务器。 本发明还提供了一种基于关系型兴趣点移动增强现实客户端对增强现实内容进行 展现的方式， 如图 14所示， 具体步骤包括： 步骤 S1402: 移动增强现实客户端接收增强现实内容展示请求； 步骤 S1404: 移动增强现实客户端判断展示请求中所指示的展示风格， 当判断出 展示风格为 "全局关联风格" 时， 执行步骤 S 1406, 当判断出展示风格为 "单一关联 风格" 时， 转而执行步骤 S1408; 步骤 S1406: 对于 "全局关联风格"， 移动增强现实客户端提取全局相关联增强现 实目标并展示， 结束本流程； 步骤 S1408: 对于 "单一关联风格"， 移动增强现实客户端提取与对应某一增强现 实目标相关联的增强现实目标并展示。 本发明还提供了在请求搜索增强现实目标的同时， 搜索相关联增强现实目标的具 体的基于关系型兴趣点移动增强现实方法， 如图 15所示， 该方法包括： 步骤 S1502: 移动增强现实客户端根据采集得到的增强现实终端上下文 （例如： 经纬度）或者备选增强现实目标特征（例如： 图像特征描述子）， 生成增强现实目标榑 索参数， 向移动增强现实服务器发送增强现实目标搜索请求。 该增强现实目标搜索请 求中添加"相关联增强现实目标搜索指示符"及"相关联增强现实目标搜索关系"。 步骤 S1504 S1506: 移动增强现实服务器提取增强现实目标搜索请求中携带的搜 索参数， 构造查询条件， 搜索基于关系型 POI的增强现实目标信息存储， 返回相匹配 的包括相关联增强现实目标之间关系信息在内增强现实目标信息； 步骤 S1508 S1510: 移动增强现实服务器查询增强现实个性化及上下文， 包括： 相关联增强现实目标搜索偏好设置， 增强现实内容 /目标过滤偏好设置等； 步骤 S1512 S1514: 根据搜索请求中 "相关联增强现实目标搜索指示符"， 或者增 强现实个性化及上下文中相关联增强现实目标搜索偏好设置， 移动增强现实服务器按 照前述搜索匹配得到的增强现实目标信息中的关系属性， 例如： "包含"关系、 "被包 含"关系、 "相邻"关系， 进一步搜索其他尚未匹配相关联的增强现实目标； 步骤 S1516 S1518: 移动增强现实服务器请求增强现实内容服务器获取与搜索匹 配增强现实目标对应的增强现实内容； 步骤 S1520: 移动增强现实服务器根据增强现实内容 /目标过滤偏好设置执行增强 现实内容 /目标过滤， 并返回移动增强现实客户端包括相关联增强现实目标信息在内的 增强现实目标搜索响应； 步骤 S1522: 移动增强现实客户端接收搜索返回的增强现实目标信息， 提取包括 相关联增强现实目标信息在内的增强现实目标信息， 该增强现实目标信息中携带有关 系属性； 步骤 S1524: 移动增强现实客户端接收用户全局关联风格展示请求， 移动增强现 实客户端根据所提取的增强现实目标关系， 展示包括相关联增强现实目标在内的全局 增强现实目标信息； 步骤 S1526: 接收用户单一关联风格展示请求， 移动增强现实客户端根据所提取 的增强现实目标关系， 展示包括相关联增强现实目标在内的某一增强现实目标信息。 本发明还提供了获取增强现实内容的同时， 搜索相关联增强现实目标的具体的基 于关系型兴趣点移动增强现实方法的实施例， 如图 16所示， 该方法包括： 步骤 S1602: 移动增强现实客户端根据用户交互请求， 生成增强现实内容获取参 数， 向移动增强现实服务器发送增强现实内容获取请求。 在该增强现实内容获取请求 中添加 "相关联增强现实目标搜索指示符"及 "相关联增强现实目标搜索关系"； 步骤 S1604 S1606: 移动增强现实服务器提取增强现实内容获取请求中携带的获 取参数， 请求增强现实内容服务器获取对应增强现实内容； 步骤 S1608 S1610: 移动增强现实服务器查询增强现实个性化及上下文， 包括： 相关联增强现实目标搜索偏好设置， 增强现实内容 /目标过滤偏好设置等； 步骤 S1612 S1614: 根据获取请求中"相关联增强现实目标搜索指示符"， 或者增 强现实个性化及上下文中相关联增强现实目标搜索偏好设置， 移动增强现实服务器按 照对应增强现实目标信息中的关系属性， 譬如： "包含"关系、 "被包含"关系、 "相邻" 关系， 进一步搜索相关联的增强现实目标； 步骤 S1616: 移动增强现实服务器根据增强现实内容 /目标过滤偏好设置执行增强 现实内容 /目标过滤， 并返回移动增强现实客户端包括相关联增强现实目标信息在内的 增强现实内容获取响应； 步骤 S1618: 移动增强现实客户端接收返回的增强现实内容， 提取增强现实目标 关系属性中涉及到的相关联增强现实目标信息； 步骤 S1620: 接收用户相关联增强现实目标展示请求， 移动增强现实客户端展示 所提取的相关联增强现实目标信息。 本发明还提供了请求搜索相关联增强现实目标的具体的基于关系型兴趣点移动增 强现实方法的实施例， 如图 17所示， 该方法包括： 步骤 S1702: 移动增强现实客户端根据采集得到的增强现实终端上下文 （例如： 经纬度）或者备选增强现实目标特征（例如： 图像特征描述子）， 生成增强现实目标搜 索参数， 向移动增强现实服务器发送增强现实目标搜索请求； 步骤 S1704 S1706: 移动增强现实服务器提取所述增强现实目标搜索请求中携带 的搜索参数， 构造查询条件， 搜索基于关系型 POI的增强现实目标信息存储， 返回相 匹配的包括相关联增强现实目标之间关系信息在内的增强现实目标信息； 步骤 S1708 S1710: 移动增强现实服务器查询增强现实个性化及上下文， 包括： 相关联增强现实目标搜索偏好设置， 增强现实内容 /目标过滤偏好设置等； 步骤 S1712 S1714: 移动增强现实服务器请求增强现实内容服务器获取与搜索匹 配增强现实目标对应的增强现实内容； 步骤 S1716: 移动增强现实服务器根据增强现实内容 /目标过滤偏好设置执行增强 现实内容 /目标过滤， 并返回移动增强现实客户端增强现实目标搜索响应； 步骤 S1718: 移动增强现实客户端接收搜索返回的增强现实目标信息， 但其中并 未包含增强现实关系属性中涉及到的所有相关联增强现实目标信息； 步骤 S1720: 接收用户相关联增强现实目标展示请求， 移动增强现实客户端查询 增强现实目标关系属性， 确定展示请求中涉及的相关联增强现实目标； 步骤 S1722 S1724: 移动增强现实客户端向移动增强现实服务器发送相关联增强 现实目标搜索请求； 步骤 S1726 S1728: 移动增强现实服务器提取所述增强现实目标搜索请求携带的 搜索参数， 构造查询条件， 搜索基于关系型 POI的增强现实目标信息存储， 返回相匹 配的增强现实目标信息； 步骤 S1730: 移动增强现实服务器向移动增强现实客户端返回相关联增强现实目 标搜索响应； 步骤 S1732: 移动增强现实客户端执行相关联增强现实目标信息展示。 在本发明上述实施例中所提及的关联关系主要有： 地理位置关联关系， 包括： 包含关系、 被包含关系、 相邻关系等。 这里以兴趣点 A和兴趣点 B之间的关系为例对上述这些地理位置关联关系进行说明。 具体的： "包含"（Contains)关系， 表示在物理构成上一个兴趣点 （例如： POI A) 包含另 一个兴趣点 （例如： POI B);
"被包含"（Contained-within)关系， 表示在物理构成上一个兴趣点 （POI B) 被另 一个兴趣点 （POI A) 包含；
"临近 "（Adjacent-to)关系， 表示一个兴趣点 （P0I A) 与另一个兴趣点 （POI B) 在部署的地理位置上相临近； 逻辑隶属关联关系， 包括： 父亲关系、 孩子关系、 相似关系等。 这里以兴趣点 A 和兴趣点 B之间的关系为例对上述逻辑隶属关联关系进行说明。 具体的：
"父亲"（Parent)关系， 表示在隶属关系上一个兴趣点 （POI A) 拥有另一个兴趣 点 (POI B), 或者是其父亲； "孩子 "(Child)关系，表示在隶属关系上一个兴趣点（POI B)被另一个兴趣点（POI
A) 所拥有， 或者是其孩子。
"相似"（Similar with) 关系， 表示在某种特征上 （类别、 类型、 价格） 一个兴趣 点 （POI A) 与另一个兴趣点 （POI B) 相似； 时间维度关联关系， 包括： 历史关系、 未来关系等。 这里以兴趣点 A和兴趣点 B 之间的关系为例对上述时间维度关联关系进行说明。 具体的：
"历史"（Historical)关系， 表示在时间维度上一个兴趣点 （P0I A) 与另一个兴趣 点 （POI B) 在过去某个历史时刻相对应；
"未来"（Future)关系， 表示在时间维度上一个兴趣点 （POI A) 是另一个兴趣点 (POI B) 在未来某个时刻相对应的兴趣点。 从以上的描述中， 可以看出， 本发明实现了如下技术效果： 本发明提供一种基于关系型兴趣点 （P0I) 移动增强现实方法和系统， 不仅可以 根据用户当前位置或者终端采集图像搜索增强现实目标， 还能够结合附近部署目标之 间关联关系为用户返回增强现实兴趣点 （P0I)。 一方面， 用户可以获知搜索返回增强 现实兴趣点 （P0I) 之间关系信息， 方便后续 P0I 的访问操作， 譬如： 邻近访问、 父 子访问、 同类访问等； 另一方面， 用户可以提前了解搜索范围之外增强现实兴趣点 (P0I), 避免错过其他感兴趣增强现实信息。 移动增强现实服务器根据增强现实目标搜索请求或增强现实内容获取请求中携带 的搜索相关联的增强现实目标的指示信息进行相关联的增强现实目标的搜索， 解决了 现有技术中因仅仅对请求中的对象进行搜索而造成的搜索结果不全面的问题， 达到了 增强现实应用中搜索到的信息更为全面的技术效果， 使得用户可以获取更为全面的增 强现实信息， 提高了增强现实应用的用户体验。 显然， 本领域的技术人员应该明白， 上述的本发明的各模块或各步骤可以用通用 的计算装置来实现， 它们可以集中在单个的计算装置上， 或者分布在多个计算装置所 组成的网络上， 可选地， 它们可以用计算装置可执行的程序代码来实现， 从而， 可以 将它们存储在存储装置中由计算装置来执行， 并且在某些情况下， 可以以不同于此处 的顺序执行所示出或描述的步骤， 或者将它们分别制作成各个集成电路模块， 或者将 它们中的多个模块或步骤制作成单个集成电路模块来实现。 这样， 本发明不限制于任 何特定的硬件和软件结合。 以上所述仅为本发明的优选实施例而已， 并不用于限制本发明， 对于本领域的技 术人员来说， 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内， 所作的 任何修改、 等同替换、 改进等， 均应包含在本发明的保护范围之内。

Claims

权 利 要 求 书
1. 一种移动增强现实搜索方法， 包括：
移动增强现实服务器接收移动增强现实客户端发送的增强现实目标搜索请 求；
所述移动增强现实服务器根据所述增强现实目标搜索请求中携带的搜索参 数， 搜索需要被识别并返回的增强现实目标；
所述移动增强现实服务器搜索与所述已搜索到的增强现实目标相关联的增 强现实目标；
所述移动增强现实服务器将搜索到的增强现实目标的信息返回所述移动增 强现实客户端。
2. 根据权利要求 1所述的方法， 其中， 所述移动增强现实服务器搜索与所述已搜 索到的增强现实目标相关联的增强现实目标的步骤包括：
所述移动增强现实服务器根据所述搜索参数中的第一指示符， 确定增强现 实目标关联关系；
所述移动增强现实服务器搜索与所述已搜索到的增强现实目标之间具有所 述增强现实目标关联关系的增强现实目标。
3. 根据权利要求 2所述的方法， 其中， 所述增强现实目标关联关系包括以下至少 之一： 包含关系、 被包含关系、 相邻关系。
4. 根据权利要求 2所述的方法， 其中， 所述增强现实目标关联关系包括以下至少 之一： 父亲关系、 孩子关系、 历史关系、 未来关系。
5. 根据权利要求 1所述的方法， 其中， 所述移动增强现实服务器搜索与所述已搜 索到的增强现实目标相关联的增强现实目标的步骤包括：
所述移动增强现实服务器判断所述搜索参数中是否存在第二指示符，其中， 所述第二指示符用于指示对与所述已搜索到的增强现实目标相关联的增强现实 目标进行搜索；
若存在所述第二指示符， 则所述移动增强现实服务器进一步搜索与所述已 搜索到的增强现实目标相关联的增强现实目标。 根据权利要求 1所述的方法， 其中， 在所述移动增强现实服务器搜索与所述已 搜索到的增强现实目标相关联的增强现实目标之后， 还包括：
所述移动增强现实服务器判断所述搜索参数中是否存在第三指示符，其中， 所述第三指示符用于指示搜索与所述已搜索到的增强现实目标相关联的增强现 实目标对应的增强现实内容；
若存在所述第三指示符， 则所述移动增强现实服务器搜索与所述已搜索到 的增强现实目标相关联的增强现实目标对应的增强现实内容。 一种移动增强现实搜索方法， 包括：
移动增强现实服务器接收移动增强现实客户端发送的增强现实内容获取请 求；
所述移动增强现实服务器根据所述增强现实内容获取请求中携带的参数， 搜索需要被获取并返回的增强现实内容；
所述移动增强现实服务器搜索与所述获取的增强现实内容对应的增强现实 目标相关联的增强现实目标；
所述移动增强现实服务器将所述获取的增强现实内容以及与所述获取的增 强现实内容对应的增强现实目标相关联的增强现实目标的信息返回所述移动增 强现实客户端。 根据权利要求 7所述的方法， 其中， 所述移动增强现实服务器搜索与所述增强 现实内容对应的增强现实目标相关联的增强现实目标的步骤包括：
所述移动增强现实服务器根据所述参数中的第一指示符， 确定增强现实目 标关联关系；
所述移动增强现实服务器搜索与所述获取的增强现实内容对应的增强现实 目标之间具有所述增强现实目标关联关系的增强现实目标。 根据权利要求 8所述的方法， 其中， 所述增强现实目标关联关系包括以下至少 之一： 父亲关系、 孩子关系、 历史关系、 未来关系。 根据权利要求 7所述的方法， 其中， 所述移动增强现实服务器搜索与所述增强 现实内容对应的增强现实目标相关联的增强现实目标的步骤包括： 所述移动增强现实服务器判断所述参数中是否存在第二指示符， 其中， 所 述第二指示符用于指示对与所述获取的增强现实内容对应增强现实目标相关联 的增强现实目标进行搜索；
若存在所述第二指示符， 则所述移动增强现实服务器进一步搜索与所述获 取的增强现实内容对应的增强现实目标相关联的增强现实目标。
11. 根据权利要求 7所述的方法， 其中， 在所述移动增强现实服务器搜索与所述增 强现实内容对应的增强现实目标相关联的增强现实目标之后， 还包括：
所述移动增强现实服务器判断所述参数中是否存在第三指示符， 其中， 所 述第三指示符用于指示获取与所述获取的增强现实内容对应的增强现实目标相 关联的增强现实目标对应的增强现实内容；
若存在所述第三指示符， 则所述移动增强现实服务器搜索与所述获取的增 强现实内容对应的增强现实目标相关联的增强现实目标对应的增强现实内容。
12. 一种移动增强现实搜索方法， 包括：
移动增强现实客户端根据用户上下文和 /或用户偏好在增强现实目标搜索 请求中提供搜索参数， 其中， 所述搜索参数用于请求移动增强现实服务器搜索 增强现实目标， 以及搜索与所述增强现实目标相关联的增强现实目标；
所述移动增强现实客户端发送所述增强现实目标搜索请求至所述移动增强 现实服务器。
13. 根据权利要求 12所述的方法，其中，所述移动增强现实客户端根据用户上下文 和 /或用户偏好在增强现实目标搜索请求中提供搜索参数的步骤包括：
所述移动增强现实客户端在所述搜索参数中添加第一指示符， 其中， 所述 第一指示符用于指示增强现实目标关联关系， 以请求所述移动增强现实服务器 搜索与所述增强现实目标具有所述增强现实目标关联关系的增强现实目标。
14. 根据权利要求 13所述的方法，其中，所述增强现实目标关联关系包括以下至少 之一： 包含关系、 被包含关系、 相邻关系、 父亲关系、 孩子关系、 历史关系、 未来关系。 根据权利要求 12所述的方法，其中，所述移动增强现实客户端根据用户上下文 和 /或用户偏好在增强现实目标搜索请求中提供搜索参数的步骤包括： 所述移动增强现实客户端在所述搜索参数中添加第二指示符， 其中， 所述 第二指示符用于指示对与所述增强现实目标相关联的增强现实目标进行搜索。
16. 根据权利要求 12所述的方法，其中，所述移动增强现实客户端根据用户上下文 和 /或用户偏好在增强现实目标搜索请求中提供搜索参数的步骤包括：
所述移动增强现实客户端在所述搜索参数中携带第三指示符， 其中， 所述 第三指示符用于指示所述移动增强现实服务器搜索与所述需要被识别并返回的 增强现实目标相关联的增强现实目标对应的增强现实内容。
17. 一种移动增强现实搜索方法， 包括：
移动增强现实客户端在增强现实内容获取请求中提供参数， 其中， 所述参 数用于请求移动增强现实服务器获取增强现实内容， 以及搜索与获取的增强现 实内容对应的增强现实目标相关联的增强现实目标；
所述移动增强现实客户端发送所述增强现实内容获取请求至所述移动增强 现实服务器。
18. 根据权利要求 17所述的方法，其中，所述移动增强现实客户端在增强现实内容 获取请求中提供参数的步骤包括：
所述移动增强现实客户端在所述参数中添加第一指示符， 其中， 所述第一 指示符用于指示增强现实目标关联关系， 以请求所述移动增强现实服务器搜索 与获取的增强现实内容对应的增强现实目标相关联的增强现实目标。
19. 根据权利要求 18所述的方法，其中，所述增强现实目标关联关系包括以下至少 之一： 包含关系、 被包含关系、 相邻关系、 父亲关系、 孩子关系、 历史关系、 未来关系。
20. 根据权利要求 17所述的方法，其中，所述移动增强现实客户端在增强现实内容 获取请求中提供参数的步骤包括：
所述移动增强现实客户端在所述参数中添加第二指示符， 其中， 所述第二 指示符用于指示对与获取的增强现实内容对应的增强现实目标相关联的增强现 实目标进行搜索。
21. 根据权利要求 17所述的方法，其中，所述移动增强现实客户端在增强现实内容 获取请求中提供所述参数的步骤包括： 所述移动增强现实客户端在所述参数中携带第三指示符， 其中， 所述第三 指示符用于指示所述移动增强现实服务器获取与所述获取的增强现实内容对应 增强现实目标相关联的增强现实目标对应的增强现实内容。
22. 一种移动增强现实搜索方法， 包括：
移动增强现实客户端接收移动增强现实服务器返回的增强现实目标搜索响 应；
所述移动增强现实客户端提取所述增强现实目标搜索响应中携带的增强现 实目标的信息；
所述移动增强现实客户端根据所述增强现实目标的信息显示增强现实目标 之间的关联关系。
23. 根据权利要求 22所述的方法，其中，所述移动增强现实客户端显示增强现实目 标之间关联关系的步骤包括：
所述移动增强现实客户端显示搜索范围之内所有增强现实目标之间的关联 关系； 或者，
所述移动增强现实客户端显示一个增强现实目标所对应的关联关系。
24. 根据权利要求 22或 23所述的方法， 其中， 所述关联关系包括以下至少之一： 包含关系、 被包含关系、 相邻关系、 父亲关系、 孩子关系、 历史关系、 未来关 系。
25. 一种移动增强现实服务器， 包括：
接收单元， 用于接收移动增强现实客户端发送的增强现实目标搜索请求； 第一搜索单元， 用于根据所述增强现实目标搜索请求中携带的搜索参数， 搜索需要被识别并返回的增强现实目标；
第二搜索单元， 用于搜索与所述已搜索到的增强现实目标相关联的增强现 实目标；
返回单元， 用于将所述搜索到的增强现实目标的信息返回所述移动增强现 实客户端。 种移动增强现实服务器， 包括：
接收单元，设置为接收移动增强现实客户端发送的增强现实内容获取请求; 第一搜索单元， 设置为根据所述增强现实内容获取请求中携带的参数， 搜 索需要被获取并返回的增强现实内容；
第二搜索单元， 设置为搜索与所述获取的增强现实内容对应的增强现实目 标相关联的增强现实目标；
返回单元， 设置为将所述获取的增强现实内容以及与所述获取的增强现实 内容对应的增强现实目标相关联的增强现实目标的信息返回所述移动增强现实 客户端。
27. 一种移动增强现实客户端， 包括：
提供单元，设置为根据用户上下文和 /或用户偏好在增强现实目标搜索请求 中提供搜索参数， 其中， 所述搜索参数用于请求移动增强现实服务器搜索增强 现实目标以及与所述增强现实目标相关联的增强现实目标；
发送单元，设置为发送所述增强现实目标搜索请求至移动增强现实服务器。
28. 一种移动增强现实客户端， 包括：
提供单元， 设置为在增强现实内容获取请求中提供参数， 其中， 所述参数 用于请求移动增强现实服务器获取增强现实内容， 以及搜索与获取的增强现实 内容对应的增强现实目标相关联的增强现实目标；
发送单元， 设置为发送所述增强现实内容获取请求至所述移动增强现实服 务器。
29. 一种移动增强现实客户端， 包括：
接收单元，设置为接收移动增强现实服务器返回的增强现实目标搜索响应; 提取单元， 设置为提取所述增强现实目标搜索响应中携带的增强现实目标 的信息；
显示单元， 设置为根据所述增强现实目标的信息显示增强现实目标之间的 关联关系。
30. 一种移动增强现实搜索系统， 包括： 权利要求 25或 26所述的移动增强现实服 务器和权利要求 27至 29任一项所述的移动增强现实客户端。
PCT/CN2013/071779 2012-03-15 2013-02-22 移动增强现实搜索方法、客户端、服务器及搜索系统 Ceased WO2013135132A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP13760820.4A EP2827617A4 (en) 2012-03-15 2013-02-22 SEARCH METHOD, CLIENT, SERVER AND SEARCH SYSTEM ASSOCIATED WITH MOBILE AUGMENTED REALITY TECHNOLOGY
US14/385,246 US20150081675A1 (en) 2012-03-15 2013-02-22 Mobile augmented reality search method, client, server and search system
JP2014561271A JP5970565B2 (ja) 2012-03-15 2013-02-22 移動拡張現実サーチ方法、クライアント、サーバ及びサーチシステム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210069029.6 2012-03-15
CN201210069029.6A CN103309895B (zh) 2012-03-15 2012-03-15 移动增强现实搜索方法、客户端、服务器及搜索系统

Publications (1)

Publication Number Publication Date
WO2013135132A1 true WO2013135132A1 (zh) 2013-09-19

Family

ID=49135132

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/071779 Ceased WO2013135132A1 (zh) 2012-03-15 2013-02-22 移动增强现实搜索方法、客户端、服务器及搜索系统

Country Status (5)

Country Link
US (1) US20150081675A1 (zh)
EP (1) EP2827617A4 (zh)
JP (1) JP5970565B2 (zh)
CN (1) CN103309895B (zh)
WO (1) WO2013135132A1 (zh)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140053099A1 (en) * 2012-08-14 2014-02-20 Layar Bv User Initiated Discovery of Content Through an Augmented Reality Service Provisioning System
CN104462155B (zh) * 2013-09-25 2018-01-30 高德软件有限公司 一种兴趣点父子关系的建立方法及装置
CN103606310B (zh) * 2013-10-29 2016-01-13 中兴通讯股份有限公司 教学方法及系统
EP3340188A4 (en) * 2015-08-20 2019-05-22 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM
CN106126067B (zh) * 2016-06-28 2019-09-27 Oppo广东移动通信有限公司 一种触发增强现实功能开启的方法、装置及移动终端
CN107728776A (zh) * 2016-08-11 2018-02-23 成都五维译鼎科技有限公司 信息采集的方法、装置、终端及系统及用户终端
CN106503810A (zh) * 2016-10-21 2017-03-15 国网山东省电力公司泰安供电公司 一种暖通设备巡检装置和方法
CN108009176B (zh) * 2016-10-28 2022-07-19 百度在线网络技术（北京）有限公司 基于ar技术的说明书展示方法、装置及设备
EP3388929A1 (en) * 2017-04-14 2018-10-17 Facebook, Inc. Discovering augmented reality elements in a camera viewfinder display
CN107085868A (zh) * 2017-04-27 2017-08-22 腾讯科技（深圳）有限公司 图像绘制方法及装置
CN109189214A (zh) * 2018-08-15 2019-01-11 苏州梦想人软件科技有限公司 基于移动设备的增强现实交互系统、设备和方法
US11727255B2 (en) 2019-10-15 2023-08-15 Rutgers, The State University Of New Jersey Systems and methods for edge assisted real-time object detection for mobile augmented reality
CN116561451A (zh) * 2022-01-27 2023-08-08 腾讯科技（深圳）有限公司 增强现实的目标展示方法、装置、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102142005A (zh) * 2010-01-29 2011-08-03 株式会社泛泰 提供增强现实的系统、终端、服务器及方法
CN102194007A (zh) * 2011-05-31 2011-09-21 中国电信股份有限公司 获取移动增强现实信息的系统和方法
CN102292707A (zh) * 2011-05-11 2011-12-21 华为终端有限公司 实现增强现实应用的方法及系统
EP2428915A2 (en) * 2010-09-09 2012-03-14 Pantech Co., Ltd Method and apparatus for providing augmented reality (AR)

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6985240B2 (en) * 2002-12-23 2006-01-10 International Business Machines Corporation Method and apparatus for retrieving information about an object of interest to an observer
US7873911B2 (en) * 2004-08-31 2011-01-18 Gopalakrishnan Kumar C Methods for providing information services related to visual imagery
US8180396B2 (en) * 2007-10-18 2012-05-15 Yahoo! Inc. User augmented reality for camera-enabled mobile devices
WO2010024584A2 (ko) * 2008-08-27 2010-03-04 키위플주식회사 객체 인식시스템, 이를 갖는 무선 인터넷 시스템 및 이를 이용한 객체기반 무선통신 서비스 방법
WO2010032079A2 (en) * 2008-09-17 2010-03-25 Nokia Corp. User interface for augmented reality
JP5247337B2 (ja) * 2008-10-02 2013-07-24 キヤノン株式会社 画像認識装置および画像認識方法
CA2748024A1 (en) * 2008-12-22 2010-07-01 Intelligent Spatial Technologies, Inc. System and method for exploring 3d scenes by pointing at a reference object
US9195898B2 (en) * 2009-04-14 2015-11-24 Qualcomm Incorporated Systems and methods for image recognition using mobile devices
JP2011081556A (ja) * 2009-10-06 2011-04-21 Sony Corp 情報処理装置、情報処理方法、プログラムおよびサーバ
JP5405412B2 (ja) * 2010-08-11 2014-02-05 株式会社Ｎｔｔドコモ オブジェクト表示装置及びオブジェクト表示方法
KR101329882B1 (ko) * 2010-08-12 2013-11-15 주식회사 팬택 Ａｒ 정보창 표시를 위한 사용자 장치 및 그 방법
KR101357262B1 (ko) * 2010-08-13 2014-01-29 주식회사 팬택 필터 정보를 이용한 객체 인식 장치 및 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102142005A (zh) * 2010-01-29 2011-08-03 株式会社泛泰 提供增强现实的系统、终端、服务器及方法
EP2428915A2 (en) * 2010-09-09 2012-03-14 Pantech Co., Ltd Method and apparatus for providing augmented reality (AR)
CN102292707A (zh) * 2011-05-11 2011-12-21 华为终端有限公司 实现增强现实应用的方法及系统
CN102194007A (zh) * 2011-05-31 2011-09-21 中国电信股份有限公司 获取移动增强现实信息的系统和方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2827617A4 *

Also Published As

Publication number Publication date
EP2827617A4 (en) 2015-12-09
JP5970565B2 (ja) 2016-08-17
JP2015513155A (ja) 2015-04-30
US20150081675A1 (en) 2015-03-19
CN103309895B (zh) 2018-04-10
EP2827617A1 (en) 2015-01-21
CN103309895A (zh) 2013-09-18

Similar Documents

Publication Publication Date Title
CN103309895B (zh) 移动增强现实搜索方法、客户端、服务器及搜索系统
KR101526837B1 (ko) 클라이언트 디바이스들 간에 데이터를 교환하기 위한 방법, 시스템 및 장치
US9338589B2 (en) User-generated content in a virtual reality environment
US8386458B2 (en) Mobile terminal device and computer program
WO2020044097A1 (zh) 一种实现位置服务的方法和装置
KR101660271B1 (ko) 메타데이터 태깅 시스템, 이미지 검색 방법, 디바이스 및 이에 적용되는 제스처 태깅방법
CN111164983B (zh) 互联终端出借本地处理能力
US9064326B1 (en) Local cache of augmented reality content in a mobile computing device
CN105095490A (zh) 目标图片搜索方法、终端及系统
CN105117455A (zh) 沿途目标图片搜索方法、终端及系统
WO2012126381A1 (zh) 一种用于获取与现实场景相关的共享对象的设备和方法
CN106202115A (zh) 一种定向显示信息方法及装置
KR20150026367A (ko) 화면 미러링을 이용한 서비스 제공 방법 및 그 장치
JP2018049623A (ja) 空間オブジェクト検索並べ替え方法及びクラウドシステム
CN113891105A (zh) 画面显示方法和装置、存储介质及电子设备
CN115114544A (zh) 事件信息的展示方法和装置、存储介质及电子设备
TWI642002B (zh) 適地性空間物件可視範圍管理方法與系統
CN102810099A (zh) 增强现实视图的存储方法和装置
KR20130062799A (ko) 키워드 정보 제공 방법
JP2015018421A (ja) 端末装置、投稿情報送信方法、投稿情報送信プログラムおよび投稿情報共有システム
CN104980807B (zh) 一种用于多媒体互动的方法及终端
CN113961828A (zh) 消息展示方法及其装置
US9697182B2 (en) Method and system for navigating a hard copy of a web page
JP6204957B2 (ja) 情報処理装置、情報処理方法および情報処理プログラム
CN103546551A (zh) 应用软件智能下载方法、装置和系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13760820

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013760820

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2014561271

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14385246

Country of ref document: US