Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
  • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
  • G06F21/31—User authentication
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
  • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
  • G06F21/31—User authentication
  • G06F21/36—User authentication by graphic or iconic representation
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
  • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
  • G02B27/01—Head-up displays
  • G02B27/017—Head mounted
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
  • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
  • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
  • G06F21/31—User authentication
  • G06F21/316—User authentication by observing the pattern of computer usage, e.g. typical user behaviour
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
  • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
  • G06F21/31—User authentication
  • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
  • G06T19/006—Mixed reality
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L63/00—Network architectures or network communication protocols for network security
  • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L63/00—Network architectures or network communication protocols for network security
  • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
  • H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
  • H04W12/06—Authentication
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
  • H04W12/30—Security of mobile devices; Security of mobile applications
  • H04W12/33—Security of mobile devices; Security of mobile applications using wearable devices, e.g. using a smartwatch or smart-glasses
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
  • G06F3/013—Eye tracking input arrangements

Definitions

• the present disclosure is directed, in general, to the use of augmented reality in an industrial setting and more specifically, to a system and method for providing secure access to data using a wearable augmented reality system.
• Augmented Reality is a technology in which digital information is presented on top of or in relationship to the physical space or a real- world object.
• There are different hardware approaches in order to visualize AR content including, see-through head-mounted displays (HMD), hand-held devices in which the reality is seen through a camera (e.g. smartphones or tablets), or using a projector displaying information on top of the physical space.
• Handheld approaches can interfere with the user's ability to use their hands and AR experiences using a projector are typically stationary.
• Head-mounted displays are becoming more popular. They can be used to overlay the user's view of the real world with an additional digital information layer. Depending on the technology that is being used, the information can either be presented at a fixed position on the screen or presented spatially aligned at a distinct position directly in the real space. HMDs are also referred to as smart glasses or smart eye- wear. Popular examples of HMDs include Google's Google Glass®, Microsoft's Microsoft HoloLens®, and the Meta Company's Meta 2®.
• the Microsoft HoloLens® is a HMD that is capable of creating a spatial room model of the physical space. At all times, the device is aware of the user's position in the room and is constantly updating the room model according to potential changes in the geometry and the user's point of view.
• a method of using a head-mounted display to enable the display of confidential data includes authenticating a user by placing the HMD on the user's head, moving the HMD by moving the user's head to facilitate the user looking at a series of N objects in a predefined order, and providing access to the confidential data in response to the user looking at the predefined series of N objects in the predefined order and within a predefined time frame, wherein N is greater than zero.
• a method of using a head-mounted display (HMD) to enable the display of confidential data includes authenticating a user by initiating a login process, starting a timer, moving the HMD with the user's head to facilitate the user looking at a first object. The method also includes moving the HMD with the user's head to facilitate the user looking at a second object, moving the HMD with the user's head to facilitate the user looking at an Nth object, and providing access to the confidential data in response to looking at the first object through the Nth object in a predefined order prior to the passage of a predetermined amount of time as measured by the timer.
• HMD head-mounted display
• a method of using a head-mounted display (HMD) to enable the display of confidential data includes authenticating a user by initiating a login process, moving the HMD with the user's head to facilitate the user looking at a first object within a predefined time from the initiation of the login process, moving the HMD with the user's head to facilitate the user looking at an Xth object within a predefined time from the completion of looking at the X-l object, and providing access to the confidential data in response to looking at the first object through an Nth object in a predefined order without exceeding any of the predefined times.
• HMD head-mounted display
• FIG. 1 is a schematic illustration of a user with a head-mounted display.
• Fig. 2 is the user's view of a workspace through the HMD of Fig. 1 illustrating a spatial password.
• FIG. 3 is a perspective view of a manufacturing shop floor through a head-mounted display illustrating digital information available to the user.
• Fig. 4 is a flowchart illustrating one possible login process.
• FIG. 5 is a schematic illustration of a data processing system.
• Fig. 6 is the user's view of a workspace through the HMD of Fig. 1 illustrating a virtual password.
• Fig. 7 is the user's view of a workspace through the HMD of Fig. 1 illustrating a hybrid password.
• Fig. 8 is a flowchart illustrating another possible login process.
• association with and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like.
• first”, “second”, “third” and so forth may be used herein to refer to various elements, information, functions, or acts, these elements, information, functions, or acts should not be limited by these terms. Rather these numeral adjectives are used to distinguish different elements, information, functions or acts from each other. For example, a first element, information, function, or act could be termed a second element, information, function, or act, and, similarly, a second element, information, function, or act could be termed a first element, information, function, or act, without departing from the scope of the present disclosure.
• adjacent to may mean: that an element is relatively near to but not in contact with a further element; or that the element is in contact with the further portion, unless the context clearly indicates otherwise.
• phrase “based on” is intended to mean “based, at least in part, on” unless explicitly stated otherwise.
• Fig. 1 illustrates a user 10 wearing an augmented reality (AR) device in the form of a head-mounted display 15 (HMD).
• AR devices such as the head-mounted display 15 of Fig. 1 allow visualizations that map the data created in the factories directly into the physical space of the factories and can help to manage the available data directly at the source of origin.
• the HMD 15 of Fig. 1 includes a translucent visor that can be seen through by the user 10 to allow the user 10 to see the actual or physical space 20 (shown in Fig. 2).
• a virtual space including virtual objects 25 (shown in Fig. 3), can be projected onto the lens and introduced into the physical space 20 to create the augmented reality.
• the virtual objects 25 could be 2D images or 3D images, sound, 2D or 3D objects as may be required.
• the user 10 could walk through a production space 20 and look at an actual machine 30 that is being operated. Data such as the machine's current utilization rate and maintenance history could be projected onto the machine 30 as a 2D note 25.
• Data about the operator such as a name or company history could be projected onto the operator or the machine 30 to further aid the user 10.
• an indictor 37 positioned over the machine 35 could indicate that it is down for maintenance.
• the user 10 could look at the machine and use hand gestures or other techniques to get additional information including the schedule for the repair and a listing and visual representation of replacement parts that are needed. In this way, the user 10 could simply walk through the factory and gain a basic understanding of the status of the machines, processes, and people within that factory.
• Figs. 2-7 illustrate a system and method for quickly, easily, and reliably implementing the desired security protocols without discouraging the user 10.
• Figs. 2, 3, 6, and 7 illustrate multiple variations of a look to unlock password.
• the head-mounted display 15 of Fig. 1 is a spatially-aware smart device that projects virtual information onto the actual or physical space 20 or object and is also aware of its position and orientation within a space or room. This spatial awareness assures that the HMD 15 properly identifies objects within the physical space 20 by simply looking or gazing at them.
• a spatial password (Figs. 2 and 3), a virtual password (Fig. 6), or a hybrid password (Fig. 7).
• the spatial password utilizes actual physical objects within the physical space 20 for password elements
• the virtual password uses virtual objects that exist only in the virtual space for password elements
• the hybrid password uses objects from both the physical space and the virtual space as password elements.
• Fig. 2 illustrates a login process that greatly simplifies the use of the HMD 15 and uses a spatial password. As illustrated in Fig. 2, the user 10 picks a number of distinct points 40, 45, 50 in the physical space 20 and in a particular order.
• the points 40, 45, 50 can be preselected by the user much like a user picks a password or can be defined by another. This pattern becomes that user's spatial password for the HMD 15.
• the user 10 first looks at the lower left corner of the leftmost monitor 40. The user 10 then looks at the top inside corners of the two monitors 45. Finally, the user 10 looks at the upper left corner of the wall outlet 50 to complete the login.
• three or more points 40, 45, 50 should be used as a password. Of course, more or fewer points 40, 45, 50 could be required for the login if desired.
• a time limit for inputting or looking at the necessary points 40, 45, 50 is typically established.
• one construction uses a timer (in a separate computer or the HMD 15) to provide the user 10 ten seconds or to look at the necessary points 40, 45, 50 in the correct order to complete the login.
• a timer in a separate computer or the HMD 15
• longer or shorter times could be used as desired.
• other constructions could use any number of points with longer passwords being harder to crack and shorter passwords being faster to input.
• the HMD 15 provides a visual or audible signal as each point is looked at to aid the user 10 in completing the login process. For example, one construction illuminates the selected point with a translucent colored box when it is correctly selected.
• the user 10 can stand anywhere in the room and look at the selected points 40, 45, 50. In other words, the user 10 does not have to stand in the same location each time a login is required. Thus, as illustrated in Fig. 3 if a user 10 selected points 55, 60, 65 that were visible everywhere on a factory floor (e.g., features in the roof or ceiling) the user 10 could complete the login from any location within the factory. In addition, since only the user 10 knows the order and the position of the specific points 55, 60, 65, the technique protects the user 10 against eavesdropping as a potential attacker cannot distinguish if the user 10 is entering a password by looking at the space or if the user 10 is already logged in and viewing content.
• the user 10 first defines a password by clicking on distinct areas in the room using a tap gesture or another gesture. The order in which the distinct areas are added becomes the order in which they must be looked at in order to login. As noted, in future logins the user 10 only has to look at the pre-designated points, within the specific time frame, and in the correct order in which they were defined. If the user 10 does this unlocking process (login process) correctly, the HMD 15 will be unlocked and the user 10 can access and view
• the points are preferably not highlighted in any way (until they are selected), as knowing each correct area is a prerequisite for entering the login password.
• some indication of a selection such as a tone, a flash, or highlighting the point in a translucent geometric shape can be given to queue the user 10 to move to the next point.
• users 10 wearing a head- mounted display 15 can quickly and easily authenticate themselves in order to access and view confidential content on the HMD 15.
• the user 10 simply enters his or her spatial password by looking or gazing at distinct points, in a distinct order in the user's physical space while wearing the HMD.
• Fig. 4 is a flow chart illustrating the most significant steps in the login process just described.
• the login process starts at the start block 70 with the first step being the user 10 initiating the authentication process 75. This could be started with a particular gesture, with the entry of a text field, with a verbal command, by turning on the HMD with the login process being required before use of the device can begin operation, or any other suitable technique.
• the next step is to start a timer 80, if a timer 80 is employed, that is either part of an outside computer system or part of the user's HMD 15. Typically, the timer 80 sets a limit of between 10 seconds and 60 seconds with other time limits being possible.
• the user 10 then turns to look at the first point of his or her login 85.
• the user 10 can move on to the next point. In some constructions an indicator is provided to queue the user 10 to move on.
• a loop 90 is repeated for each subsequent point until the Nth point is reached with N being the number of points required to complete the login (step 95).
• the timer 80 is checked at step 100 to verify that the points were entered in the required amount of time. Alternatively, the timer 80 operates in the background and if the predetermined time is exceeded, the login process is considered failed and is immediately restarted. Typically, the timer runs throughout the login process and once the timer expires, the process is interrupted and returned to the start block 70.
• the login is complete (step 105) and the user 10 has access to the data associated with his or her account. Also, as noted above, the use of the timer 80 is optional and could be completely omitted if desired.
• Fig. 8 is a flow chart illustrating this process which includes many steps similar to those shown in Fig. 4.
• the system verifies that the selection was made within a predetermined time limit 88 (e.g., 5 to 60 seconds).
• a predetermined time limit 88 e.g., 5 to 60 seconds.
• the time limit is compared to the time between initiation of the login process and the user looking at the first point.
• the timer simply operates in the background and reinitiates the login process if any of the predetermined time limits are exceeded. The user then looks at the next point 90 and must do so within the predefined time limit.
• the time limit is compared to the time that passes between looking at the current point and the point immediately prior (The X-l point). This process continues until the user looks at the Nth or last point. If each point is looked at within the predetermined time limits, the login is successfully completed 105. However, if any one of the time limits is exceeded, the login process is immediately re-initiated. It should be understood that various aspects of the login processes illustrated in Figs. 4 and 8 can be combined in any number of ways to achieve the level of security desired for a particular application.
• the login process is terminated, and the user must re-start the login process.
• the use may be allowed a number of incorrect selections before the process must be re-started. For example, in one system a user is allowed two incorrect selections at each point. If the third selection is incorrect, the process must be restarted.
• the user is allowed a total number of errors throughout the process. For example, the user may be allowed three incorrect selections during the process of selecting three points. In this scenario, if the user incorrectly selects two points while trying to select the first point, that user will have one error left before being required to restart the process.
• the login process and the password generation process just described are similar for virtual passwords and for hybrid passwords as the only real difference is the element that makes up the various selected points.
• one method provides a number of pre-selected virtual objects 130 in a password space 110 that appears to the user each time a password is required.
• the pre-selected objects 130 could be selected beforehand and used repeatedly or could be randomly selected from a large group of options or from a pre-selected subgroup at each login by the computer.
• one system includes hundreds of potential objects including animals, toys, vehicles, sports equipment, etc.
• the password space 110 includes a one meter by one meter square cross sectioned annular area spaced one meter from the user (i.e., a square donut surrounding the user).
• the HMD 15 places the pre-selected objects 130 at random locations.
• the objects 130 could appear as 2D or 3D objects as desired.
• the user selects the correct objects 130 in the correct order to enter the password.
• Fig. 6 illustrates a potential password space 110 that includes a number of virtual objects 130 randomly positioned in the desired space. The user selects the three objects 130 that make up the password by looking at them in the correct order.
• the first point is the tractor 1 15
• the second point is the chair 120
• the third point is the tree 125.
• the virtual passwords have several advantages over spatial passwords. For example, the virtual passwords allow the user to login from any location since the objects 130 are simply displayed by the HMD 15. In addition, because the virtual objects 130 are randomly positioned, the user must look in different directions and must make different movements each time a login is attempted.
• Hybrid passwords illustrated in Fig. 7 include password elements that are both spatial and virtual.
• a system that uses a hybrid password would be restricted to a particular location as at least one spatial object would need to be selected.
• the hybrid passwords would have the added security offered by the virtual passwords as at least one virtual element 130 would need to be selected.
• hybrid passwords are created and entered as described above with regard to the spatial passwords.
• Fig. 7 illustrates an example of a hybrid password.
• the password space 110 includes a number of virtual objects 130 randomly positioned in the desired space and overlying the physical space 20. The use selects the three objects that make up the password by looking at them in the correct order.
• the first point is the tractor 115
• the second point is the chair 120
• the third point is the HVAC control 125 mounted on the wall which is a physical object in the physical space 20.
• the system 900 may comprise a combination 910 including at least one processor 902 (e.g., a microprocessor/CPU) that is configured to carry out various processes and functions described herein by executing from a memory 904, executable instructions 906 (such as software/firmware instructions) corresponding to one or more software/firmware applications 908 or portions thereof that are programmed to cause the at least one processor 902 to carry out the various processes and functions described herein.
• processor 902 e.g., a microprocessor/CPU
• executable instructions 906 such as software/firmware instructions
• processor 902 (sometimes referred to as a controller or control system) corresponds to any electronic device that is configured via hardware circuits, software, and/or firmware to process data.
• processors 902 described herein may correspond to one or more (or a combination) of a microprocessor, CPU, or any other integrated circuit (IC) or other type of circuit that is capable of processing data in a data processing system.
• IC integrated circuit
• a processor that is described or claimed as being configured to carry out a particular described/claimed process or function may: correspond to a CPU that executes computer/processor executable instructions stored in a memory in the form of software and/or firmware to carry out such a described/claimed process or function; and/or may correspond to an IC that is hard wired with processing circuitry (e.g., an FPGA or ASIC IC) to carry out such a described/claimed process or function.
• processing circuitry e.g., an FPGA or ASIC IC
• a processor that is described or claimed as being configured to carry out a particular described/claimed process or function may correspond to the combination 910 of the processor 902 with the software instructions 906 loaded/installed into the described memory 904 (volatile and/or non-volatile), which are currently being executed and/or are available to be executed by the processor 902 to cause the processor 902 to carry out the described/claimed process or function.
• a processor that is powered off or is executing other software, but has the described software instructions installed on a storage device in operative connection therewith (such as a hard drive or SSD) in a manner that is setup to be executed by the processor (when started by a user, hardware and/or other software), may also correspond to the described/claimed processor 902 that is configured to carry out the particular processes and functions described/claimed herein.
• Memory 904 may correspond to an internal or external volatile memory (e.g., main memory, CPU cache, and/or RAM), that is included in the processor and/or in operative connection with the processor. Such a memory 904 may also correspond to a nonvolatile memory (e.g., flash memory, SSD, hard drive, or other storage device or non-transitory computer readable media) in operative connection with the processor 902.
• volatile memory e.g., main memory, CPU cache, and/or RAM
• nonvolatile memory e.g., flash memory, SSD, hard drive, or other storage device or non-transitory computer readable media
• the described data processing system 900 may include at least one input device 912 and at least one display or output device 914 in operative connection with the processor 902.
• the input device 912 may include a mouse, keyboard, touch screen, gesture input device, or other type of input device capable of providing user inputs to the processor 902.
• the display device 914 may include an LCD or AMOLED display screen, monitor, head-mounted display, or any other type of display device or output device capable of displaying outputs from the processor 902.
• processor 902, memory 904, software instructions 906, input device 912, and display device 914 may be included as part of a data processing system corresponding to a PC, workstation, server, notebook computer, tablet, mobile phone, head-mounted display, or any other type of computing system, or any combination thereof.
• the data processing system 900 may also include one or more data stores 916.
• the processor 902 may be configured to manage, retrieve, generate, use, revise, and store data and/or other information described herein from/in the data store 916.
• Examples of a data store may include a file and/or a record stored in a database (e.g., Oracle, Microsoft SQL Server), file system, hard drive, SSD, flash drive, memory card and/or any other type of device or system that stores non-volatile data.
• non-transitory machine usable/readable or computer usable/readable mediums include: ROMs, EPROMs, magnetic tape, hard disk drives, SSDs, flash memory, CDs, DVDs, and Blu-ray disks.
• the computer/processor executable instructions may include a routine, a sub-routine, programs, applications, modules, libraries, and/or the like. Further, it should be appreciated that computer/processor executable instructions may correspond to and/or may be generated from source code, byte code, runtime code, machine code, assembly language, Java, JavaScript, Python, C, C#, C++ or any other form of code that can be programmed/configured to cause at least one processor to carry out the acts and features described herein. Still further, results of the described/claimed processes or functions may be stored in a computer-readable medium 916, displayed on a display device 914, and/or the like.
• input devices 912 or output devices 914 may both provide inputs and receive outputs of communications with the data processing system 900.
• the processor 902 may be integrated into a housing (such as a tablet or head-mounted display) that includes a touch screen or that is capable of capturing motion gesture inputs that serves as both an input and display device.
• some input devices may include a plurality of different types of input devices (e.g., touch screen, touch pad, and keyboard).
• controller means any device, system or part thereof that controls at least one operation, whether such a device is implemented in hardware, firmware, software or any combination thereof. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.
• the described processor and memory may be included in a controller. Further, a controller may correspond to the described data processing system or any other hardware circuit that is operative to control at least one operation.
• data processing systems may include virtual machines in a virtual machine architecture or cloud space.
• the processor 902 and associated components may correspond to the combination of one or more virtual machine processors of a virtual machine operating in one or more physical processors of a physical data processing system.
• the processor 902 described herein may correspond to a remote processor located in a data processing system such as a server that is remote from the display 914 and input devices 912 described herein.
• the described display device 914 and input device 912 may be included in a client data processing system (which may have its own processor) that communicates with the server (which includes the remote processor) through a wired or wireless network (which may include the Internet).
• client data processing system may execute a remote desktop application or may correspond to a portal device that carries out a remote desktop protocol with the server in order to send inputs from an input device to the server and receive visual information from the server to display through a display device.
• Such remote desktop protocols include Teradici's PCoIP, Microsoft's RDP, and the RFB protocol.
• a client data processing system may execute a web browser or thin client application. Inputs from the user may be transmitted from the web browser or thin client application to be evaluated on the server, rendered by the server, and an image (or series of images) sent back to the client data processing system to be displayed by the web browser or thin client application.
• the remote processor described herein may correspond to a combination of a virtual processor of a virtual machine executing in a physical processor of the server.
• the data processing system 900 in this example may correspond to a controller, computer, workstation, server, PC, notebook computer, tablet, mobile phone, and/or any other type of apparatus/system that is operative to process data and carry out functionality and features described herein associated with the operation of a data processing system, computer, processor, software components, and/or a controller discussed herein.
• the depicted example is provided for the purpose of explanation only and is not meant to imply architectural limitations with respect to the present disclosure.
• a system or component may be a process, a process executing on a processor, or a processor. Additionally, a component or system may be localized on a single device or distributed across several devices.

Landscapes

• Engineering & Computer Science (AREA)
• Computer Security & Cryptography (AREA)
• Theoretical Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• Software Systems (AREA)
• Computer Networks & Wireless Communication (AREA)
• Signal Processing (AREA)
• Optics & Photonics (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Computing Systems (AREA)
• Computer Graphics (AREA)
• Human Computer Interaction (AREA)
• Biomedical Technology (AREA)
• Social Psychology (AREA)
• User Interface Of Digital Computer (AREA)

Priority Applications (2)

Applications Claiming Priority (2)

Publications (1)

Family

ID=62117152

Family Applications (1)

Country Status (3)

Families Citing this family (5)

Citations (4)

Family Cites Families (28)

• 2018
  • 2018-04-24 EP EP18723310.1A patent/EP3616110A1/de not_active Withdrawn
  • 2018-04-24 US US16/603,625 patent/US11416600B2/en active Active
  • 2018-04-24 WO PCT/US2018/029039 patent/WO2018200449A1/en not_active Ceased

Patent Citations (4)

Also Published As

Similar Documents

Legal Events