WO2012155179A1 - Procédé dans un système informatique - Google Patents

Procédé dans un système informatique Download PDF

Info

Publication number
WO2012155179A1
WO2012155179A1 PCT/AU2012/000495 AU2012000495W WO2012155179A1 WO 2012155179 A1 WO2012155179 A1 WO 2012155179A1 AU 2012000495 W AU2012000495 W AU 2012000495W WO 2012155179 A1 WO2012155179 A1 WO 2012155179A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual object
user
data
virtual
interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/AU2012/000495
Other languages
English (en)
Inventor
Jade Wood BURTON
Kieran GALVIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IGOBUBBLE Ltd
Original Assignee
IGOBUBBLE Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2011901836A external-priority patent/AU2011901836A0/en
Application filed by IGOBUBBLE Ltd filed Critical IGOBUBBLE Ltd
Publication of WO2012155179A1 publication Critical patent/WO2012155179A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0277—Online advertisement

Definitions

  • the present invention relates to methods in a computing system, a computing system and clients for communicating with a computing system.
  • the present invention relates to an augmented reality system, components therefore, and methods in such a system.
  • Augmented reality systems exist in which a user's device is provided with a hybrid visual, auditory or other interface including a first portion which represents reality and a second portion, usually overlaid on top of the first portion, to provide additional information than can be perceived by the user in real time.
  • the mobile user terminal is used as a view finder through which a scene can be viewed and onto which is overlaid points marking virtual objects and locations that may be of interest to a user.
  • virtual objects may exist.
  • Virtual objects typically exist as data in a database structure of the augmented reality system which specifies a virtual object's parameters such as its appearance and access permission. Typically, these parameters are fixed or only able to be changed by a virtual object creator or owner. This can lead to many virtual objects becoming stale over time and uninteresting to users as the virtual object's properties are essentially static.
  • augmented reality systems of this type are typically constrained in the way that a user may interact with them and accordingly over time user interest in the systems may diminish. In a commercial sense, if these systems are used for notifying potential customers or otherwise advertising to users a decrease in user interest will translate into a decrease in advertiser interest and hence a decrease in revenue for the system operator.
  • augmented reality systems may be improved by allowing augmented reality virtual objects to evolve over time.
  • the augmented reality virtual objects can preferably be adapted to change their behaviour in response to interactions with users of the system. Any aspect of the behaviour of a virtual object may change including, but not limited to, the way in which a virtual object behaves during interactions with either users or other virtual objects, the rendering behaviour of the virtual object, or a health parameter of the virtual object.
  • Triggers for changing the behaviour of the virtual object are preferably based on an interaction between a user and the virtual object, or the user and another virtual object. Interactions may take many forms and can include interactions in which the user is passive or active and even interactions in which the user ignores or fails to interact with the virtual object.
  • the virtual objects do not become stale over time, and they gain an animacy and interactivity not realisable in the more static prior art systems.
  • the present invention provides a method in a computing system.
  • the computing system includes: a data storage system storing data representing at least one virtual object, said data representing the at least one virtual object including virtual object behaviour data and virtual object location data, and a data processing system configured to process data stored in the system, and to communicate with a user device via at least one communications channel.
  • the method includes: identifying an interaction between a virtual object and a user; and updating virtual object behaviour data relating to one or more virtual objects in response to the identified interaction.
  • the step of identifying an interaction can comprise a step of receiving data identifying a virtual object.
  • the step of identifying an interaction can comprise a step of receiving data representing a user input signifying a user initiated interaction with a virtual object.
  • the user initiated interaction can include any one of: the user using the virtual object; the user copying the virtual object; the user retaining the virtual object; me user viewing the virtual object; the user accessing the virtual object; the user accepting the virtual object; the user capturing the virtual object; the user moving the virtual object; the user modifying the virtual object; and the user releasing the virtual object.
  • the computing system can perform a step of transmitting data including data enabling or facilitating the rendering or other reproduction of the virtual object.
  • the step of identifying an interaction can comprise: receiving data representing a location of a user; determining a proximity between a user and a location corresponding to the virtual object location data; and in the event that the proximity is within an predetermined radius of the virtual object and/or user, determining that an interaction has occurred.
  • the step of updating virtual object behaviour data relating to one or more virtual objects can include updating association data relating the virtual object to the user.
  • the step of updating association data relating the virtual object to the user can include updating the virtual object location data for the virtual object.
  • the method can further include checking access permission data of at least one of the virtual objects or user.
  • the computer system can perform a step of copying the virtual object.
  • the step of updating the association data can comprise associating the user with the virtual object.
  • the step of updating the association data can comprise dissociating the user from the virtual object.
  • Updating the virtual object behaviour data can include modifying the data representing the virtual object such that its location data is determined by reference to a user rather than a location.
  • Updating the virtual object behaviour data can include modifying the data representing the virtual object such that its location data is determined by reference to a location rather than a user.
  • Modifying the virtual object behaviour data can include a step of modifying data corresponding to the rendering or other reproduction behaviour of the virtual object.
  • Modifying the virtual object behaviour data can include a step of modifying data corresponding to the interaction behaviour of the virtual object.
  • Modifying the virtual object behaviour data can include a step of modifying data corresponding to the health of the virtual object.
  • Modifying the virtual object behaviour data can include a step of modifying data corresponding to a virtual object related to the virtual object.
  • Modifying the interaction behaviour data can include a step of updating or providing user permission to interact with the virtual object.
  • the step of modifying the interaction behaviour data can include a step of updating or providing an interaction type specifying the nature of interaction between a user and virtual object; or between virtual objects.
  • the step of modifying the interaction behaviour data can include a step of updating an interaction radius applicable to the virtual object.
  • the step of modifying data corresponding to the rendering behaviour or reproduction behaviour can include providing data representing a style of rendering the virtual object.
  • the step of modifying data corresponding to the rendering behaviour can include providing data representing a visibility radius applicable to the rendered virtual object.
  • the step of modifying data corresponding to the health of the virtual object can include updating data corresponding to a time to live of the virtual object.
  • the step of updating virtual object behaviour data can include updating data that indirectly moderates a behaviour of the virtual object.
  • the method can include incrementing, decrementing or re-setting a time to live of a virtual object in response to a user interaction with a virtual object.
  • the data storage system can also store data representing a health parameter of a virtual object.
  • the method can include: updating the health parameter of one or more virtual objects from time to time.
  • the health parameter of one or more virtual objects can be updated periodically.
  • the step of updating preferably includes decrementing the health of one or more virtual objects.
  • the health parameter of substantially all virtual objects can be decremented periodically.
  • step of updating virtual object behaviour data relating to one or more virtual objects can include updating data relating to at least one virtual object associated with the virtual object involved in the identified interaction.
  • the virtual object(s) to be updated could be associated with the virtual object by any one or more of the following attributes:
  • an augmented reality system including: a data storage system.
  • the data storage system stores data representing: at least one virtual object, including virtual object behaviour data and virtual object location data; and at least one user.
  • the system also includes data processing system configured to implement a method as described herein. Most preferably the method is performed in accordance with an embodiment of the first aspect of the invention.
  • the data storage system can include media storage for storing media virtual objects associated with one or more virtual objects.
  • the augmented reality system can further include at least one interface to a communications network to receive and/or transmit data from and/or to a user client device.
  • the interface(s) can be adapted to exchange any one or more of: interaction data, location data, virtual object data with the user device.
  • the present invention provides a client for an augmented reality system.
  • the client provides an augmented reality interface including, an user interface portion corresponding to a real world scene and a portion representing one or more virtual objects; a user input portion enabling a user to interact with a virtual object according to behaviour data corresponding with a virtual object.
  • the client also includes a communication portion confined to communicate with an augmented reality system to exchange at least interaction data and behaviour data.
  • the client can be configured to perform or enable any one or more of the following interactions: the user using the virtual object; the user copying the irtual object; the user retaining the virtual object; the user viewing the virtual object; the user accessing the virtual object; the user accepting the virtual object; the user capturing the virtual object; the user moving the virtual object; the user modifying the virtual object; and the user releasing the virtual object.
  • the client can be adapted to interact with a system as described herein. Most preferably it is adapted to interact with a system according to the second aspect of the present invention.
  • the client can be implemented in a mobile computing device.
  • the mobile computing device preferably includes a locator component configured to determine the location of the mobile computing device.
  • the client is a software application configured to be run on a computing device.
  • Figure 1 is a schematic representation of a communications, computing and positioning system infrastructure in which a system according to the present invention may be implemented;
  • Figure 2 A illustrates schematically an augmented reality system and client application used in an embodiment of the present invention;
  • Figure 2B and 2C together provide an entity relationship diagram illustrating an exemplary set of database tables used in an embodiment of the present invention
  • Figure 3 A is a flowchart illustrating the process of determining user and virtual object position with in the augmented reality system according to one embodiment of the present invention
  • Figure 3B illustrates the movement of a user through space illustrating virtual objects moving into range and out of range in the example of figure 3 A
  • Figure 4 is a sequence diagram illustrating an exemplary user initiated interaction, in the form of a request to view a virtual object, according to an embodiment of the present invention
  • Figure 5 illustrates a flowchart illustrating how a user interaction may cause a virtual object may be split in an embodiment of the present invention
  • Figure 6 illustrates a flowchart showing an example of an interaction between a user and a virtual object, where the interaction is initiated by a virtual object without user input.
  • FIG. 1 is a schematic representation of a communications, computing and positioning system infrastructure in which a system according to the present invention may be implemented.
  • the infrastructure 100 generally includes a network 102, positioning system 120, and augmented reality system 122.
  • the network 102 will typically be a telecommunications system such as a cellular telephone and data network. However, as will be appreciated by those skilled in the art the network 102 need not be a cellular telephone network, as is illustrated, but may be any type of communication network capable of communicating with user devices over a data channel.
  • the cellular telephone and data network 102 illustrated includes a plurality of cells 104, having has a respective base station 106 for communicating with user devices located in a surrounding area.
  • a plurality of user devices are in communication with the network 102.
  • the user device are in the form of, smart phones 108, tablet computer devices 110, notebook computer 112 and mobile computing device 114, the mobile computing device may for instance be a navigation system or other in-car computing system.
  • many other types of user device could be used in embodiments of the present invention and the invention should not be considered as being limited to the examples given herein.
  • the transmitters 106 of the communications network 102 are communicatively connected to a core or backbone network which enables communication between the various cells, and with other networks via a network control infrastructure subsystem, e.g. 116.
  • the network 102 is also connected to, or forms part of, a data communications and computing network 118, such as the Internet.
  • the user devices 108 to 114 operating within the telecommunications network 102 preferably also receive signals from a constellation of positioning satellites, such as the positioning satellites 119 of the GPS system 120, in order to determine their respective position.
  • the positioning may be performed using Assisted-GPS whereby part of the GPS data is delivered via the communications network 102 to the user device 1 8 to 114.
  • the user devices 108 to 114 communicate with an augmented reality system 122 via the telecommunications network 102 and data communication network 118.
  • Figure 2A illustrates more details of an embodiment of the augmented reality system of the type illustrated in figure 1.
  • the system 200 shown in Figure 2A communicates with a user device running a client application 212.
  • the system 200 includes the following main subsystems:
  • a data storage subsystem including a database 201 and cloud storage 204.
  • An Application Server 202 (or group of servers) and push notification service
  • a web interface comprising a web service 208 and dynamic website 210.
  • the client application 212 provides an interface through which a user interacts with the system 200. User can also interact with the system 200 using a web browser 214 to access the dynamic website 210.
  • the database 201 includes one or more tables 200.1, and associated stored procedures
  • the database 201 stores the information that is required to model of the state of the objects in the augmented reality world.
  • the database 201 can store data representing all entities within the augmented reality world, the primary entities being virtual objects and users. However other entities may also exist, e.g. virtual object owners, such as advertisers or corporations that are not users, system administrators or management.
  • the database 201 can also store system business rules and other data necessary for the system to operate.
  • Figures 2B and 2C together present an entity relationship diagram illustrating an exemplary set of database tables that can be used in an embodiment of the present invention.
  • Tables 1 to 3 set out attributes that can be stored in the entity tables for virtual objects, users and modules respectively, in an embodiment of the present invention.
  • EntitylD Unique Surrogate identifier for the virtual object.
  • EntityDescription Optional text description of the virtual object.
  • CreatorAccountID ID referring to the Account responsible for creating the virtual object.
  • HolderAccountID ID referring to the Account of the user who presently holds this virtual object. May be NULL if the virtual object is not held by anyone.
  • GpsCoordinate in some embodiments.
  • FamilylD A number that acts like a logical "last name" of the virtual object.
  • a virtual object has the same FamilylD as the virtual object that it was cloned from or split from. In this way, virtual objects can be grouped by a common FamilylD.
  • GpsCoordinate changes. This is a cumulative distance, in metres.
  • ViewCount A number that is incremented whenever the virtual object's canvas is viewed by user.
  • EditCount A number that is incremented whenever the virtual object's canvas is modified by a user.
  • CaptureCount A number that is incremented whenever the virtual object is captured.
  • birthplaceGpsCoordinate A GPS coordinate that is set once, when the virtual object is cloned at a location, or splits at a location, or is initially released at a location.
  • Table 1 Attributes stored for virtual objects in an exemplary embodiment of the preser invention
  • ProfileCanvasID ID referring to a canvas that represents the user's profile.
  • PrivateEmailAddress If the user forgets their password, they can opt for it to be sent to this email address automatically.
  • Password The user's secret password, used for authentication.
  • CreationDateTime The date and time that the account was created. IsOnline A 1 or 0 value indicating that the user is presently online.
  • LastLoggedOff The date and time that the user last logged off.
  • DeviceToken A device token used by Apple Push Notification Service to
  • LastUpdated The date and time that the account was last modified.
  • LastLoggedOn The date and time that the user last logged on.
  • GpsCoordinate A last-known GPS coordinate of the user.
  • Table 2 Attributes stored for a user in an exemplary embodiment of the present invention
  • EditAccess An enumeration indicating what general edit access users have.
  • RejectReason A string field which may contain a free-text explanation or comment on the ReviewStatus, as entered by a moderator.
  • CreationDateTime The date and time that this module was created.
  • DefaultWidth A module may appear as many different sizes on multiple canvases simultaneously. This field indicates what width to use when the object is first added to a canvas.
  • Picture_DataObjectID For Picture modules refers to a file stored in the cloud which contains the picture data.
  • TapToCall_PhoneNumber For "Tap to call” modules, the phone number to dial when the user taps on the button.
  • Video_StillImageObjectID For Video modules, refers to a file stored in the cloud which contains a still image of the video.
  • Video_DataObjectID For Video modules refers to a file stored in the cloud which contains the video data.
  • UrlJJrl For URL modules, the URL to browse to when the user taps on the button.
  • GpsLocation_GpsPosition For GPS Location modules, the GPS position to reveal on a map.
  • CalendarReminder DateTime For Calendar Reminder modules the date/time to add to the user's calendar when the user taps on the button.
  • CalendarReminder_Description For Calendar Reminder modules, a text description of the reminder.
  • BusinessCard_PhoneNumber For Business Card modules a phone number to add to the user's contacts list when the user taps on the button.
  • BusinessCard_EmailAddress For Business Card modules an email to add to the user's contacts list when the user taps on the button.
  • File_DataObjectID For File modules refers to a file stored in the cloud.
  • Text_Text For Text modules refers to the text that will be displayed.
  • Text FontSize For Text modules indicates the size of the font to use.
  • Text FontName For Text modules indicates the font name to use.
  • Text_Red For Text modules indicates the red component of an RGB colour to use.
  • Canvas_Width For Canvas modules, indicates the width of the canvas in pixels. Note that a Canvas is itself a Module, and so resides in the same table.
  • Canvas_Height For Canvas modules indicates the height of the canvas in pixels.
  • Canvas_BackgroundRed For Canvas modules indicates the red component of the RGB background colour.
  • IsTemplate 1 if this is a Canvas module that is to be usable as a template.
  • Table 3 Attributes stored for Modules in an exemplary embodiment of the present invention.
  • the database 201 can be centralised or split across several databases (as illustrated in this embodiment) which are stored on one or more servers and/or server farms.
  • the system may store data remotely on a cloud storage server 204.
  • the cloud storage system is used to store media and other data that forms part of the virtual objects. This data is stored in a cloud storage system so as to minimise data transfer from the main database 201 which stores system state. This can speed up system access and allow system expansion as more virtual objects are created over time.
  • Clearly choice between centralised and cloud storage or the balance between them can change depending on system requirements.
  • Virtual objects can contain a range of information. Turning firstly to their appearance in the virtual world and the user experience they deliver to users that interact with them in use.
  • Virtual objects can be viewed in a similar fashion to websites or other documents, in that they have a structure defined by a set of parameters, termed a “canvas” herein, and content, termed “modules”.
  • a virtual object can comprise one or more “modules” arranged on a "canvas”.
  • a canvas in one form has a height and width, measured in pixels; although non visual virtual objects could also be created, in which case other parameters defining their structure will be used, say duration etc.
  • a module is a piece of digital media that can be distributed with a virtual object, e.g. by placement on a canvas, or that is made accessible at a location specified with a fixed virtual object. Examples of modules include but are not limited to, the following:
  • a text block having a font, font size, colour, rotation and alignment.
  • An image e.g. possibly having a rotation and a non-destructive cropping region, so that it can be changed many times without affecting the underlying pixel data.
  • the cropping region could be any shape or weight, allowing the user to paste on non-rectangular "cut outs" of people and virtual objects.
  • a video including parameters as to whether it is to be played embedded or full- screen.
  • a Location e.g. GPS location.
  • a Document e.g. in portable document format or any other document format.
  • a shared file e.g.
  • a virtual object may have a different appearance depending on whether a user is merely viewing it from a distance or has captured it.
  • a virtual object's appearance or modes of interaction will be much richer to a user that possesses the virtual object, but present a less sophisticated or detailed interface to users passively observing it or passing by.
  • the virtual object can have a thumbnail image that is created by cropping a main image of the virtual object or similar or play a snippet of a video or sound rather than the whole thing.
  • virtual objects In addition to the content of virtual object that can be experienced by a user during an interaction, virtual objects also include a range of other data, including but not limited to: Lineage data and ownership data - this data is used to record and track the creation and manipulation of virtual objects over its life. Some aspects can be used to modulate interactions with other virtual objects or users.
  • This data can be data relating to one or more of the following:
  • Virtual object data relating to parent or child virtual objects.
  • Location and movement data an important aspect of many virtual objects is their position and ability to move. Thus each virtual object will have at least one item of location data associated with it.
  • Location data can include, but is not limited to:
  • Movement status e.g. whether the virtual objection is fixed, mobile, autonomous etc. Movement parameters, such as speed, direction, conditions upon movement.
  • Target position e.g. whether the virtual objection is fixed, mobile, autonomous etc.
  • Movement parameters such as speed, direction, conditions upon movement.
  • Target position e.g. whether the virtual objection is fixed, mobile, autonomous etc.
  • Movement parameters such as speed, direction, conditions upon movement.
  • Target position e.g. whether the virtual objection is fixed, mobile, autonomous etc.
  • Historical position originating position.
  • Health data as will become apparent from the following description a virtual object's behaviour within the virtual world can be modulated by its health. Thus each virtual object will have some health related data, for example:
  • a virtual object size A time to live.
  • a status e.g. live, dead, expired, etc.
  • Interaction data - interaction between virtual objects and users is central to the operation of the Augmented reality system according to the present invention.
  • some interaction-specific data can also be stored in the database, for example:
  • This data can be used by system administrators, virtual object creators or owners, advertisers or others to monitor virtual objects.
  • the data stored could include: Owner.
  • Data related to users is also stored in the database tables.
  • This data represents the state of user in the augmented reality system, and can include data relating to: User Identity.
  • a wide range of user identity data could be stored, including, but not limited to:
  • Age or date of birth User demographic data.
  • a user can have different permissions for interaction with certain virtual objects based on a range of characteristics, for example whether they are a system manager, system user, merchant, advertiser, member of a group, e.g. a club or professional organisation, child, etc.
  • the database can store data, including but not limited to any one of the following types of permission or interaction data (either storing permissions or exclusions) for a user:
  • User type User creation data.
  • Virtual object data each time a user interacts with a virtual object, data relating to the interaction can be stored for the user, for example: ,
  • Virtual object identification data including, currently possessed virtual objects and or recently possessed virtual objects, or
  • Interaction parameters for virtual objects including time, date, type, other parameters
  • User location data the system needs to know where a user is in order to allow it to determine how or if the user can interact with virtual objects in the augmented reality world.
  • the database 200 can store data such as:
  • the client application 212 provides an interface for stimulating the user and allowing the user to interact with virtual objects as part of the augmented reality service in real time.
  • the client application possesses interfaces that can allow a user to interact with virtual objects, for instance by allowing the user to view, hear, access, copy, modify, capture, accept, retain, move, release or " share the virtual object.
  • the client application can also be adapted to allow the user to create, clone or edit virtual objects.
  • the client application 212 will typically be run on a mobile user device, such as a mobile phone, ' tablet computer or other user computing device. In one example, the device running the client application could be an Apple iPhone running iOS.
  • the client application 212 has a communication component 212.1 for interfacing with the application server 202.
  • the communications component communicates with the application server 202 using a messaging protocol.
  • the messaging protocol is preferably a connectionless protocol, for example, the protocol is the User Datagram Protocol (UDP), delivered over the Internet Protocol (IP).
  • UDP User Datagram Protocol
  • IP Internet Protocol
  • the client application 212 also includes an interface layer 212.2 that controls the interface through which the user interacts with the augmented reality system.
  • the UI may have various components, e.g. a graphical user interface, audio interfaces such as sound receiving and output components, tactile interfaces e.g. a motion sensitive input device such as an accelerometer and vibrating output devices.
  • a visual user interface and virtual objects that will have a visual aspect to them, however it should be noted that the user interface need not be visual in nature, and virtual object need not be perceived visually by a user. Any type of interface could be used which is perceived by any of a user's senses. Clearly the interface can use multiple modes of interaction which are perceived in different ways - in fact many interactions will use a hybrid interface, including a combination or visible, auditory and/or tactile stimuli.
  • the client application 212 also transmits location data of the user device to the application server 202. It does this by obtaining a GPS coordinate from the mobile device's built-in GPS chip, which is in communication with the positioning system 120. The client application 212 then takes the GPS coordinate and sends it to the Application Server 202 in a "Report GPS Position" request. This message is sent whenever a new GPS coordinate is received from the built-in GPS device, which can happen frequently, particularly if the user is moving.
  • the mobile client 212 receives messages from the Application Server 202 containing information relating to the virtual objects stored in the database 200, and in response provides outputs via the user's device to form an augmented reality interface. In use, the mobile client application 212 displays nearby and in-range virtual objects in relation to the user.
  • the user interface 212.2 of the mobile client operates in a Finder mode.
  • the Finder mode presents an interface displaying in-range virtual objects that the user can currently interact with.
  • the interface might, for example be a simple list interface, or provide a more dynamic graphical interface, e.g. a window full of bubble-like icons representing in-range virtual objects that float around on the screen.
  • the icons can be represented as bouncing off each other and the walls in a realistic way.
  • the user can touch and drag the bubbles on the screen to interact with them, in the manners described herein.
  • Similar interfaces can also be used to display virtual objects that the user has captured, or which have attached themselves to the user. Other interfaces are possible.
  • interfaces can be provided to help a user to find an object which the user is able to see (or detect), but that is not close enough to interact with.
  • Such an interface might look like a radar display showing icons for nearby virtual objects.
  • the interface can also include a navigational aid, say, resembling a compass to guide a user to virtual objects.
  • the Finder mode In addition to showing in-range virtual objects, the Finder mode also helps the user to discover virtual objects that are nearby but technically not in-range. Indicators are shown beneath the list items that represent in-range virtual objects, and these each display a bearing, represented as a small compass, and a minimum distance the user must travel for the virtual object to be in-range.
  • the mobile client application 212 when running on a mobile device that is physically located at, or near a physical location that corresponds to a virtual object's location can display the canvas including any modules on the screen at the request of the user.
  • the mobile client application 212 can present the canvas to the user based upon the position and orientation of the mobile device.
  • the mobile device can display a picture that comprises a representation of what the user would have seen when looking in that particular direction, and overlays upon that picture one or more modules from nearby virtual objects.
  • Access to the system may not always be provided by a dedicated client application.
  • an application that takes photos and applies filters to them could include a "Place virtual object here" button, which uses an appropriate library to add a photo to the system server, as a virtual object.
  • a “Place virtual object here” button which uses an appropriate library to add a photo to the system server, as a virtual object.
  • the system can receive content from third party applications without users needing to download a full copy of the client application.
  • such a feature could be added in a new version of a user's favourite Photo-taking application as a minor update.
  • the database 201 is connected to an Application Server 202.
  • the Application Server 202 performs two main roles.
  • the Application server mediates communication between a mobile client 212 and the database 201.
  • the communication can take a wide variety of forms. The following description will illustrate the nature of communications between the application server 202 and mobile client 212.
  • the application server 202 can communicate with a mobile client 212 to authenticate a user's identity or client's identify in order to allow access to virtual objects stored in the database; and/or convey information, such as data for representing the virtual objects visually, to the mobile client application.
  • the Application Server may communicate with the mobile client 212 via an intermediary, for example, via a push notification server 206.
  • the Application server 202 can update the database 201 according to business rules.
  • each virtual object can have an associated health parameter that is stored within the database.
  • the health parameter is decremented at regular intervals, and any virtual objects which have a health parameter that is less than a predetermined value are updated to ensure that they do not appear in the augmented reality display.
  • a virtual object expiry timestamp is consulted and/or updated as each virtual object is accessed.
  • the Application Server 202 uses a message bus architecture that allows for asynchronous unsolicited messages, or Notifications, to be dispatched to all relevant connected clients.
  • the Application Server 202 can automatically transmit a Notification to all connected clients who are in-range of the virtual object.
  • the Notification contains a copy of the virtual object, and other information such as which user performed the capture/release.
  • the Application Server 202 only selects, inserts, updates and deletes rows in the database 200 via stored procedures 200.2. This provides a layer of abstraction between the database schema and the Application Server 202 that reduces or eliminates the changes necessary on the Application Server 202 if the underlying schema of the database 201 changes, and vice- versa. The stored procedure layer also potentially affords a higher degree of security.
  • the Application Server 202 creates the virtual object or fixed virtual object, it inserts a row into the Entity table.
  • An example Entity table is illustrated in Figure 2B.
  • Entity is an abstraction of any virtual object that may have a GPS coordinate and which may be spatially queried.
  • the Entity table has a Spatial Index, which is a feature of Microsoft SQL Server. This. makes it possible to quickly perform a query of "every virtual object within 100 meters of X, Y" etc. Spatial queries are used heavily in the system.
  • the Application Server 202 could run Microsoft Windows 7 or 2003 (or other operating system), and hosts a daemon (a.k.a, "Windows Service”) written in C#.NET, which responds to requests from client application 212 apps.
  • a daemon a.k.a, "Windows Service”
  • C#.NET C#.NET
  • Virtual object information from the database 201 may also be accessed via a web browser 214 that is running on a user's or an administrator's computing device.
  • the browser 214 such as Internet Explorer, Firefox or Safari, is used to access a dynamic website.
  • the dynamic website 210 is constructed using a series of dynamically generated pages, authored in PHP and served using the Apache webserver 210.1.
  • the webserver 210.1 may access the database 201 of virtual objects via a web services interface 208.
  • the database 201 is accessed directly by the PHP code.
  • the user is using the web browser and is able to access and/or update virtual object information.
  • the web browser interface allows a merchant or advertiser to create a virtual object, and/or track the virtual object use and interactions over time.
  • the merchant can view, for example, how many people interacted with the virtual object, the demographics of those people, and the co-ordinates through which the virtual object travelled over its lifetime.
  • a merchant having a virtual object in the system can have access to an analytics portal accessible to them via the website via which they can access the following information, which can be stored or derived from data:
  • Aggregated statistics over a range of virtual objects owner by the merchant can also be presented. Additionally, financial and account data is also accessible, for example historical transaction data, as well as a merchant's credit remaining for creating or maintaining they virtual objects.
  • Data can be presented in the form of reports, mapped geographically, temporally, graphed etc. For example, the number of times a given virtual object is viewed each day, or total views for all virtual objects each day, the path followed by a virtual object.
  • Figure 3A illustrates a method of performing this process.
  • the left pane of Figure 3 A relates to operations that take place in the mobile client, and the right pane relates to operations that take place in the database or the Application Server.
  • the mobile client determines the current GPS coordinate of its mobile device.
  • user position is determined by the client application exchanging location data from the user device's inbuilt positioning chip with the application server.
  • the mobile client transmits 304 the GPS co-ordinate to the database in a "Report GPS Position" message, which receives the co-ordinate 306.
  • the database is consulted by the application server to identify any virtual objects that are near to the GPS co-ordinate of the mobile device.
  • the Application Server 202 upon receiving the "Report GPS Position" message, performs a spatial query on the Entity table, selecting all rows whose GPS coordinate is within range of the user's current location. This range, typically expressed in meters, is typically defined by the . radius property of each virtual object, as stored in the Radius column of the Entity table.
  • the Application Server 202 has obtained a list of nearby Entities, it saves these in a second table, AccountlnRangeEntity in step 310.
  • This table creates a relationship between users (represented by the Account table) and Entities. For instance, if a . user is in-range of 10 Entities, then there will be exactly 10 records in the AccountlnRangeEntity table, respectively linking the 10 Entities back to the Account of the user.
  • step 312 information allowing visual display of virtual objects nearby to the GPS coordinate of the mobile device is then transmitted back to the mobile device.
  • step 314 the mobile device receives the virtual object information, to generate a suitable UI display based upon the information. Subsequently, the process is essentially repeated, such that the virtual object information is updated to account for any change in the user's location. That is, the user device updates its location in step 316, and sends the new location data 318 to the application server.
  • the application sever 202 receives the updated location data at 320 and repeats its database spatial query 322. For instance, as a user moves across a city, new virtual objects and fixed virtual objects "come in range", while others "go out of range”.
  • the Application Server 202 determines the changes in the in-range and out-of range virtual objects at 324 and reports these two events back to the client application 212 asynchronously via an event feed 326, allowing the client application to instantly notify the user of newly discovered virtual objects, while also updating the display to remove no-longer-in-range virtual objects. This updating process is repeated 330 as the user moves.
  • Figure 3B illustrates the movement of a user through space. The user is initially located at the centre of circle 350. The positions of virtual objects are indicated by dots. Initially the table of in-range virtual objects created by the application server includes all virtual objects within circle 350. As the user moves to the position at the centre of circle 352, the virtual objects in region 354 come into range, and those in region 356 go out-of-range. The application server reports the new in-range virtual objects and new out of range virtual objects contained in regions 354 and 356 (respectively) to the client application via an event feed.
  • a virtual object could be determined if the user initiates an interaction. This difference is essentially one of whether an interaction is virtual object initiated or user initiated.
  • Some virtual objects will automatically form associations with users. For example an interaction may result from a user moving to a particular geographic position e.g. a position that corresponds to the present position of a virtual object.
  • the system determines that an interaction between the virtual object and that user has occurred. Responsive to the interaction, the system may initiate some action on the mobile client to attract the user's attention - for example, vibrating the mobile device, or playing an audible chime.
  • An interaction may also result from a user selecting an input on their mobile device. For example, a user may select an option from a menu that allows the user to select a type of interaction with a virtual object. For example, the user may choose to capture the virtual object - that is, take the virtual object from its location and carry the virtual object with them. The user may then subsequently release the virtual object at a different location, or trade the virtual object with another user.
  • Figure 4 illustrates a process for a user-initiated interaction.
  • the interaction is a user viewing a virtual object in detail.
  • Figure 4 is divided into two panes - left and right.
  • the left pane 402 relates to operations that take place in the mobile client.
  • the centre pane 403 relates to operations that take place in the database 201.
  • the right pane 404 relates to operations that take place in the cloud storage service of the data storage system. Arrows between the panes indicate that a message is sent between the components.
  • the mobile client determines input from the user of the device that the user wishes to view one of the in-range virtual objects.
  • mobile client application 212 issues a request to the server 408, that identified the virtual object to be viewed such as a "Get Canvas" request.
  • the Application Server 202 queries the database 201 in step 412 and selects the Canvas row from the Module table, plus all child Modules, aggregates these and returns (in step 416) the complete Canvas virtual object to the client application 212. Additionally the application server updates the virtual object's data in the database 201 to reflect that it has been requested by a user.
  • the client application receives the virtual object canvas information that in this case, omits the necessary media for the user device to render or otherwise reproduce the virtual object in a manner in which it can be perceived by a user, at 418.
  • the client application requests media content that is needed to recreate the virtual object from media storage system, e.g. cloud storage 204 of figure 2, in step 420.
  • the request is received at 422 and the storage system accessed in 424 and the required content returned to the client application in step 426.
  • the client application receives the content of the virtual object 212 at 428 then performs layout and presents the Canvas at 430.
  • video and audio data contained in Modules are not stored on the Application Server 202. Instead, these data are stored on and served by in cloud storage network 204.
  • This means a PictureModule has a row in the Module table, but the actual pixel data are stored separately, in the cloud.
  • the PictureModule thus has a Picture_DataVirtual objectID column that identifies the data virtual object in the cloud storage system 204 and allows it to be retrieved.
  • Other embodiments can store the media module data to be stored in the main database 201.
  • step 414 of updating virtual object behaviour data in Figure 4 by increasing a virtual object's health is concerned with ensuring that virtual objects which are most often viewed are promoted within the system to allow them to be viewed more, whereas virtual objects which are rarely viewed will not continue to exist.
  • each virtual object has an associated 'health' parameter, which is stored in the database.
  • the health parameter is progressively reduced over time by interaction of the decay daemon and stored procedures 200.2 of the database 201, or through certain types of interaction. Health can also be increased by certain other interactions.
  • the health parameter can moderate a virtual object's interaction, by allowing the system to keep a measure of the regularity and quantity of views.
  • the concept of health can be used to promote scarcity in the virtual world by allowing old or less successful virtual objects to expire, thereby avoiding the space from becoming cluttered.
  • FIG. 5 illustrates an example of this process, and can be considered to follow on from (or be a sub-process within step 414 of figure 4).
  • the virtual object's health parameter incremented as in step 414 of figure 4.
  • the virtual object's health parameter is compared to a predetermined threshold value. If the health parameter is greater than the threshold two things occur.
  • a new virtual object is created. The new virtual object is created having a health parameter that is approximately half of the original virtual object.
  • the existing virtual object health parameter is reduced to half its former level.
  • the process of creating the new virtual object can be performed as follows:
  • the canvas of the new virtual object still refers to the same Modules that the original Canvas.
  • the position data and other relevant data associated with each Module in relation to its parent Canvas is copied and linked with the new Canvas, allowing the new virtual object to have different position information from the original virtual object.
  • the system performs a spatial query on the database 201 to determine all the users who are "in range" of the virtual object, before dispatching Notifications to them. These Notifications are interpreted by the client application 212 and the display is asynchronously updated to reflect the newly added virtual object.
  • the client application 212 is therefore responsible for downloading image, video and audio data from a separate server. It initiates this downloading as soon as the Canvas virtual object is retrieved from the Application Server 202.
  • the downloading occurs using standard HTTP GET requests, and several downloads may occur simultaneously.
  • the data virtual objects fetched from the cloud storage 204 are preferably immutable; that is, they are never updated. This allows for aggressive caching on the client side, and prevents the same data virtual object from needing to be downloaded more than once.
  • attribution of the original creators of particular modules is tracked - in particular, the system tracks the linkage between modules of content and its creator, such that even when content is mashed-up and recycled to produce derivative works, attribution of content is still possible.
  • the 'health' parameter may be artificially inflated by a single user repeatedly viewing a particular virtual object.
  • the health parameter for a virtual object only the first view by a particular user within a predetermined time period may be used to determine the health of a virtual object.
  • Figure 6 illustrates a flowchart showing an example of an interaction between a user and a virtual object, where the interaction is initiated by a virtual object without user input.
  • Figure 6 follows a similar convention as for Figure 4, whereby the left pane 602 relates to operations that take place in the mobile client and the right pane 604 relates to operations that take place in the application server.
  • the virtual object can be considered a viral object, which unilaterally attaches itself to a user as a user moves into range.
  • the client application retrieves the user's device location from the positioning chip of the user device.
  • the user location is transmitted to the application server.
  • the application server receives the user's location at 610 and performs a spatial query on the database to determine all virtual objects within a predetermined range.
  • the application server determines the user is within an interaction radius for the virtual object.
  • the database identifies that the virtual object and user will interact and updates the virtual object's behaviour data 614 to reflect that the virtual object is now associated with the user.
  • this interaction can be seen as the object hitchhiking on a user by jumping on the user, and then being carried around by the user (until it is dropped or otherwise moved on).
  • the behaviour data that is updated is the location data of the virtual object.
  • a row in the Entity table corresponding to that virtual object is updated.
  • the update sets the GpsCoordinate column to NULL and sets the Virtual ObjectAssociatedWithAccountID column to the ID of the user's Account.
  • the virtual object instead of the virtual object having a location, it has its location determined by association with a user. If the virtual object was stationary the virtual object will now become mobile and move with its user.
  • the user's account is also updated reflect that the virtual object is held by the user in 618, and the user is notified of his or her new virtual object at 620.
  • the health parameter of the virtual object may also be updated e.g. to make it healthier, increasing its time to live.
  • Information relating to one or more virtual objects is then sent back to the user's device 614 where it is received 616 and may be displayed 618.
  • Virtual objects can have different behaviours depending on whether they have been captured by the particular user.
  • the act of capturing a virtual object may be necessary prior to allowing a particular user to view the canvas of the virtual object, or a virtual object may not be visible or discoverable by other users if it is possessed by a user.
  • the variation in behaviour of a virtual object can be controlled by associating a virtual object with a particular user. For example, a private message may be sent from one user to another user by restricting the users able to view the message.
  • capturing a virtual object can be dependent on a user input.
  • the user may be able to reject the virtual object. This can be viewed as a negative interaction and user to decrement the virtual object's health parameter.
  • Releasing a virtual object is essentially the opposite process to capture.
  • the process of releasing a virtual object involves disassociating a particular user from the virtual object, and updating the virtual object to have a particular set of GPS co-ordinates.
  • releasing a virtual object involves setting VirtualObjectAssociatedWithAccountID to NULL and GpsCoordinate to the present GPS coordinate of the user.
  • the user might have received the virtual object from a friend who needs help spreading it around.
  • the virtual object's time to live might be incremented upon release.
  • Virtual objects can also be disassociated from a user in response to a negative interaction or non-use by its holder.
  • a virtual object disassociates from the user, its location will be updated so that it is no longer be determined by reference to a user, but rather, the virtual object will be available for other users to collect and associate with themselves.
  • the virtual object may be (or become) visible to all users of the system, providing an opportunity for the virtual object to continue to live on with other users.
  • a warning icon could appear to encourage the user to find a good place to drop the virtual object, allowing it to survive.
  • a user can have a "kiss-of-death " attribute that tracks the user's propensity to retain objects until they expire (instead of passing them on and thus increasing their lifespan).
  • this attribute where a virtual object decays to its death, the last user that touched it will have his kiss-of-death statistic incremented once.
  • this indicates that he is very bad at placing virtual objects in good locations and should be less desirable as a host for virtual objects to automatically attach to or those who wish to spread their own viral virtual objects.
  • virtual objects can be edited to include additional or modified modules.
  • the editing of particular virtual objects can be tracked.
  • the system may allow users to take modules from existing virtual objects and reuse these to create new virtual objects.
  • a user might decide to create a new virtual object that "borrows" modules from two or more virtual objects that are associated with her. She can then mix in her own modules if she wants to. This way, logos, pictures, videos, quotes etc. can be recycled and mashed-up to create countless new derivative works.
  • Virtual objects that share a single common ancestor object are said to be of the same family.
  • the system tries to link it to a parent virtual object.
  • Each virtual object has just one parent, the association being made by the action of cloning a virtual object.
  • the two resulting virtual objects both have the same parent.
  • the user can select a virtual object and opt to view all virtual objects that are part of the same family. Accordingly, one virtual object can be used to track potentially thousands of other related virtual objects. They may all be identical, or some may have mutated due to editing. Users can view these relative virtual objects even though they may be very far away, however they cannot edit them remotely.
  • the editing process provides an opportunity for revenue loss, since it is possible that an existing virtual object could be substantially edited in order to avoid paying for a new virtual object. Accordingly, the present system determines the similarity of edited virtual objects compared to their originals, blocking drastic edits which significantly change the original version. For example, an edit changing more than 30% of the virtual object modules may be blocked.
  • a virtual object whose health is less than a predetermined threshold may automatically merge with other virtual objects of the same family that are in proximity. This way, the life of the content is extended because one healthy virtual object will last longer than 5 unhealthy virtual objects that are close to death.
  • virtual objects may merge for the purpose of aggregating content. This is a separate scenario whereby, for example, a photo montage of one virtual object is automatically aggregated with a photo montage of another, to produce a larger, more interesting photo montage. Virtual objects in the same family may do this when they are in proximity and when some criteria have been satisfied, such as, in the given example, that both virtual objects contain sufficient photos.
  • the concept of lineage described herein could, in some embodiments, also allows an interaction with one member of a family to affect another member of a family. That is when a virtual object of a family is collected, its children or siblings may be changed in some way: e.g. to change their time to live (longer or shorter) to change their appearance; change their movement behaviour, for instance to cause them to move towards or away from the captured virtual object.
  • a user is generally unable to view a virtual object that is presently associated with another user.
  • Each party is presented with a list of virtual objects that the counterparty is willing to trade.
  • Each user makes a selection as to the virtual objects that they would like to trade, and based on their respective selections, decide whether the trade should proceed. If the trade proceeds, each virtual object that is the subject of the trade is updated to indicate an association with the respective counterparties.
  • the trading interaction results in the virtual object's association being changed form one user to another.
  • the virtual object's health can also be updated.
  • parameters that are set for a virtual object will define the virtual object's interactions and behaviours. For instance take a virtual object which, in addition to more common data, such as an appearance, location, canvas and module data, owner, health etc, has the following additional parameters defined: a desired destination or state, an action to perform when the destination is reached or the state achieved, permission only to freely associate only with users belonging to particular user group, and user association parameters that make it become associated with a member of the group that is within its interaction radius from time to time, but to preferentially make associations with users that are moving towards its destination.
  • a desired destination or state an action to perform when the destination is reached or the state achieved
  • permission only to freely associate only with users belonging to particular user group has the following additional parameters defined: a desired destination or state, an action to perform when the destination is reached or the state achieved, permission only to freely associate only with users belonging to particular user group, and user association parameters that make it become associated with a member of the group that is within its interaction radius from time to time, but to preferentially make associations with users that
  • This virtual object is intended to make its way to a given location by forming advantageous associations with predefined users.
  • Such a virtual object could be used to advertise a sponsor of a sporting team and be "planted" in the home town of the sporting team on the morning of a big game.
  • the virtual object could then attach itself to a member of the sports club and hitchhike to the game with various members along the way.
  • an event such as the awarding of a prize to one or more members of the club (e.g. the user that is carrying the virtual object at the time of arrival)
  • data defining the virtual object's movement behaviour is modified by virtue or the virtual object's association with a new user.
  • Each handover will also affect the virtual object's lifetime behaviour by increasing its health.
  • the virtual object may zero a timer which defines its maximum residence time with each user, before it starts looking for a new user to jump to.
  • the propensity to jump may also be tied to the number of club members within jumping range. To illustrate how this situation imbues a virtual object with animacy, take the contrasting situation of a virtual object placed at the main train station in a sports club's home town.
  • this virtual object will have many club members to associate with and jump between as the supporters make their way to the game. This activity will increase the health of the virtual object over time and it will arrive at the game.
  • a virtual object for the same team that is placed at the main train station in the rival's home town will struggle to find club members to carry it, and thus its health will be decremented by the system and it may even die before making the ground.
  • a small group of club members travelling to the game together from this "enemy territory" could group together to take turns in carrying the virtual object and get the virtual object to the game. If nobody picks it up, the virtual object will expire.
  • a user waiting at a bus stop creates a new virtual object and fixes it at the location of the bus stop.
  • the virtual object is a poem.
  • a subsequent person waiting at the bus stop finds the virtual object, and reads the poem.
  • the original virtual object's health is incremented so it lives on to possibly be read by another user.
  • the reader also copies the poem and creates a mobile version of the virtual object.
  • the user wants to credit the original author, and so sets a system rule that every second time their cloned virtual object is read and passed on the original virtual object's health is incremented, so as to increase the original virtual object's chance of surviving.
  • the user takes their new virtual object with them and hands it off to their friend at work. This friend enjoys the poem and passes it to her brother.
  • the copied virtual object's location data and associated data is updated, and the original virtual object's health is updated.
  • a teenager wishes to "tag" a wall with their nickname. Whereas the teenager may have traditionally used spray-paint or a similar medium, a degree of notoriety may be achieved by instead creating a virtual object at that location.
  • the virtual object medium may be particularly attractive due to its richness - in particular the ability to embed video and audio at a particular location.
  • the approach potentially also enables classification and filtering of content - for example, "tags" may be visible to users who wish to see them, but filtered for users who do not.
  • a local band wishes to promote their concert. Instead of sticking a poster to a message board, the band creates a virtual object at the location of the message board.
  • the message includes a sample track recorded live at their last performance, and a wallpaper flyer including the concert date which they can transfer to their mobile device.
  • the virtual object allows the user to easily add the concert date to their calendar. Users can interact with this virtual object at the message board.
  • the band can also leave 10 bubbles at location, or group of locations, say a shop or venue. These virtual objects can be taken away by fans.
  • the bubbles can be set to "go, off ' or "ring” at a set time to remind the user that is carrying them that the concert is in 7 hours. If a user carries one of these bubbles to the concert, and drops it there the user can be provide with some bonus, e.g. unlocking exclusive content or free entry to the venue itself.
  • a husband wishes to leave his wife a message for their anniversary. He writes a private note which he anchors at her workplace.
  • the virtual object is accessible to the couple, but not others.
  • she unlocks the virtual object to reveal the message.
  • the association data of the virtual object is updated to be attached to her.
  • a previously hidden, associated virtual object, which renders as a bunch of flowers is updated, so that its rendering behaviour changes, and it appear to spontaneously appear. This is signalled to the woman using the push notification service, so she looks at her user device and sees that she's been given flowers. In fact all users within a radius of the woman could be notified so that the act of "giving" the flowers is seen by the public.
  • the person creates a virtual object containing details of the rent, and basic contact details (including a clickable telephone number).
  • the virtual object also contains a password protected section which provides the location of the share house.
  • the virtual object is marked to allow cloning, allowing a person searching for a place to rent to collect contact details without needing to use a pen.
  • the prospective flatmate is provided with a password enabling them to easily locate the house.
  • the map interface of the client application can be user to direct the user to the house for a meeting with her potential housemates.
  • the approach opens up new possibilities for collaboration by groups of people who are only very loosely associated, for example, associated by visiting a particular geographic location. This allows a large number of users to collaborate to create various types of virtual objects, for example, a picture wall containing pictures contributed by each of the users.
  • This loose association facilitates uses that require a degree of anonymity.
  • a user may create a virtual object containing an anonymous confession.
  • virtual objects are not merely characterised by their geographic location, but rather can be characterised by their associated user. This distinction opens up further possible uses.
  • One such use is the chain or forwarded virtual object. This type of virtual object is created with forwarding instructions of some type (for example, forward to ten of your friends, forward to Barack Obama). These virtual objects rely primarily on social, rather than geographical associations in order to propagate between users.
  • the virtual objects maybe created for viewing by a future generation, such as a grandchild, or only become visible after a fixed period of time, in the nature of a time capsule.
  • the virtual object behaviour can be set to change dramatically when that person becomes associated with the user, for instance content that Was previously locked can be unlocked, or it could spawn other virtual objects as a result.
  • the present system provides commercial opportunities for businesses to either promote their real world goods and services or possible distribute services, virtual objects, e.g. containing media, via the artificial reality system.
  • virtual objects e.g. containing media
  • the predominant mechanism envisaged for this is to apply charges for providing a virtual object with "life". This can be achieved by charging the owner of a commercial virtual object each time a virtual object's health parameter is incremented.
  • a virtual object When a virtual object is created, it will have some pre-set initial health parameter. The creator can be charged for the amount of health given to the virtual object.
  • the health of the virtual objects is decremented over time, charging by the health parameter cause an advertiser to have to pay, so long as they want their advertising virtual object to remain in the augmented reality space. Incrementing health upwards upon certain user interactions also allows the system operator to charge an advertiser when a virtual object attracts a user's attention, thus tying the cost of advertising to its success.
  • aspects of the present invention can be implemented on a wide range of fixed or mobile computing hardware. That hardware can run any one of a number of suitable operating systems. Moreover aspects of the invention implemented in software could be written in any suitable programming language. Accordingly the present invention should not be considered to be limited to the hardware, operating system or software implementations, which are described herein as examples.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Theoretical Computer Science (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention porte sur des procédés dans un système informatique, un système informatique (122) et des clients (212) pour communiquer avec un système informatique. Le système comprend un système de stockage de données (200) stockant des données représentant au moins un objet virtuel ; et un système de traitement de données. Le procédé consiste à identifier une interaction entre un objet virtuel et un utilisateur ; et mettre à jour des données de comportement d'objet virtuel concernant le ou les objets virtuels en réponse à l'interaction identifiée.
PCT/AU2012/000495 2011-05-13 2012-05-09 Procédé dans un système informatique Ceased WO2012155179A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201161486164P 2011-05-13 2011-05-13
US61/486,164 2011-05-13
AU2011901836 2011-05-13
AU2011901836A AU2011901836A0 (en) 2011-05-13 Method in a computing system

Publications (1)

Publication Number Publication Date
WO2012155179A1 true WO2012155179A1 (fr) 2012-11-22

Family

ID=47176024

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2012/000495 Ceased WO2012155179A1 (fr) 2011-05-13 2012-05-09 Procédé dans un système informatique

Country Status (1)

Country Link
WO (1) WO2012155179A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3003717A1 (fr) * 2013-03-19 2014-09-26 Tamaplace Environnement informatique pour executer de facon partagee sur les postes clients des applications avec contenus et actions synchronises
EP2988473A4 (fr) * 2013-08-23 2016-04-20 Huawei Device Co Ltd Procédé, appareil et système de criblage de contenu pour réalité augmentée
US10843073B2 (en) 2016-06-28 2020-11-24 Rec Room Inc. Systems and method for managing permission for interacting with virtual objects based on virtual proximity

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7409647B2 (en) * 2000-09-19 2008-08-05 Technion Research & Development Foundation Ltd. Control of interactions within virtual environments
WO2008130842A1 (fr) * 2007-04-20 2008-10-30 Utbk, Inc. Procédés et systèmes pour raccorder des personnes via la réalité virtuelle pour des communications en temps réel
US20100070859A1 (en) * 2007-03-07 2010-03-18 Brian Mark Shuster Multi-instance, multi-user animation platforms
US7685518B2 (en) * 1998-01-23 2010-03-23 Sony Corporation Information processing apparatus, method and medium using a virtual reality space
US20100130296A1 (en) * 2008-11-24 2010-05-27 Disney Enterprises, Inc. System and method for providing an augmented reality experience
US20100304862A1 (en) * 2009-05-29 2010-12-02 Coleman J Todd Collectable card-based game in a massively multiplayer role-playing game that presents real-time state information

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7685518B2 (en) * 1998-01-23 2010-03-23 Sony Corporation Information processing apparatus, method and medium using a virtual reality space
US7409647B2 (en) * 2000-09-19 2008-08-05 Technion Research & Development Foundation Ltd. Control of interactions within virtual environments
US20100070859A1 (en) * 2007-03-07 2010-03-18 Brian Mark Shuster Multi-instance, multi-user animation platforms
WO2008130842A1 (fr) * 2007-04-20 2008-10-30 Utbk, Inc. Procédés et systèmes pour raccorder des personnes via la réalité virtuelle pour des communications en temps réel
US20100130296A1 (en) * 2008-11-24 2010-05-27 Disney Enterprises, Inc. System and method for providing an augmented reality experience
US20100304862A1 (en) * 2009-05-29 2010-12-02 Coleman J Todd Collectable card-based game in a massively multiplayer role-playing game that presents real-time state information

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3003717A1 (fr) * 2013-03-19 2014-09-26 Tamaplace Environnement informatique pour executer de facon partagee sur les postes clients des applications avec contenus et actions synchronises
EP2988473A4 (fr) * 2013-08-23 2016-04-20 Huawei Device Co Ltd Procédé, appareil et système de criblage de contenu pour réalité augmentée
KR101738443B1 (ko) 2013-08-23 2017-05-22 후아웨이 디바이스 컴퍼니 리미티드 증강 현실 콘텐츠를 스크리닝하는 방법, 장치, 및 시스템
US9788166B2 (en) 2013-08-23 2017-10-10 Huawei Device Co., Ltd. Method, apparatus, and system for screening augmented reality content
US10843073B2 (en) 2016-06-28 2020-11-24 Rec Room Inc. Systems and method for managing permission for interacting with virtual objects based on virtual proximity
US11524232B2 (en) 2016-06-28 2022-12-13 Rec Room Inc. Systems and method for managing permission for interacting with virtual objects based on virtual proximity

Similar Documents

Publication Publication Date Title
US20210056762A1 (en) Design and generation of augmented reality experiences for structured distribution of content based on location-based triggers
US9191238B2 (en) Virtual notes in a reality overlay
CN115777113B (zh) 用于重新展示内容项的消息系统
KR102677485B1 (ko) 미디어 항목들의 관여를 추적하는 시스템
US9317974B2 (en) Rendering a digital element
US8073461B2 (en) Geo-tagged journal system for location-aware mobile communication devices
KR101894835B1 (ko) 위치 연관 메시지 제시 기법
US20120209839A1 (en) Providing applications with personalized and contextually relevant content
US20130217416A1 (en) Client check-in
US20140053099A1 (en) User Initiated Discovery of Content Through an Augmented Reality Service Provisioning System
TW201030544A (en) System and method for context based query augmentation
CN103077179A (zh) 用于显示社交网络的用户的个人时间线的计算机实现方法，计算机系统及其计算机可读介质
TW200941235A (en) System and method for conditional delivery of messages
US9813861B2 (en) Media device that uses geolocated hotspots to deliver content data on a hyper-local basis
KR20190085932A (ko) 도메인 기반의 네트워크를 통한 맞춤식 사용자 생성 컨텐츠의 수집 및 제공
US10163134B2 (en) Platform content moderation
US20120303481A1 (en) System and Method for Dynamic Object Mapping
CN116636190A (zh) 用于重新展示内容项的消息收发系统
CN103024602A (zh) 一种针对视频添加批注的方法及装置
US20160267068A1 (en) System, method and process for multi-modal annotation and distribution of digital object
WO2012155179A1 (fr) Procédé dans un système informatique
CN121219740A (zh) 测量a/b排名变化对转换提升的影响的系统
CN110326030B (zh) 用于提供与虚拟内容项目相关联的嵌套内容项目的系统和方法
CN116710911B (zh) 基于标注的参与分析
CN121040022A (zh) 内容集合的共享

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12785787

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12785787

Country of ref document: EP

Kind code of ref document: A1