WO2024005518A1 - 디스플레이 장치 및 그 동작 방법 - Google Patents
디스플레이 장치 및 그 동작 방법 Download PDFInfo
- Publication number
- WO2024005518A1 WO2024005518A1 PCT/KR2023/008976 KR2023008976W WO2024005518A1 WO 2024005518 A1 WO2024005518 A1 WO 2024005518A1 KR 2023008976 W KR2023008976 W KR 2023008976W WO 2024005518 A1 WO2024005518 A1 WO 2024005518A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display device
- input signal
- controller
- server device
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/32—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using local area network [LAN] connections
- A63F13/323—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using local area network [LAN] connections between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/335—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/338—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using television networks
Definitions
- Various embodiments relate to a display device and a method of operating the same, and more specifically, to a display device and a method of operating the same using a server device and a controller.
- cloud games In cloud games, major operations such as graphics processing required for the game are performed on the cloud server device, the user's operation input from the user device such as a smart phone or smart TV is transmitted to the server device, and the rendered game screen is displayed. It refers to a game service structured to receive and display IP-streaming on the user device.
- a display device may include a communication interface, a memory that stores one or more instructions, and a processor that executes the one or more instructions stored in the memory.
- the processor By executing the one or more instructions, the processor transmits the first execution result content obtained by executing the content application based on the input signal from a controller connected to the server device and providing an input signal to the server device through the communication interface. It can be received from.
- the processor may control the display to display the first execution result content by executing the one or more instructions.
- the processor may receive a first input signal from the controller representing a predetermined value transmitted to the server device by the controller from the server device through the communication interface.
- the processor may display a user interface screen for controlling the display device according to reception of a first input signal representing the predetermined value.
- the processor may receive a second input signal from the controller while displaying the user interface screen and control the operation of the display device based on the second input signal.
- the processor By executing the at least one instruction, the processor receives a second input signal from the controller through the server device through the communication interface while displaying the user interface screen, or receives a second input signal from the controller. Input signals can be received directly from the controller through the communication interface.
- the processor controls the display to end display of the user interface screen according to a second input signal that ends display of the user interface screen while displaying the user interface screen by executing the at least one instruction. And, upon termination of display of the user interface screen, the communication interface may be controlled to transmit a signal indicating that the display device operates in a content playback control mode to the server device.
- the processor by executing the at least one instruction, executes the content application according to a third input signal received from the controller according to transmission of a signal indicating that the display device operates in a content playback control mode.
- the communication interface can be controlled to receive the second execution result content from the server device.
- the processor by executing the at least one instruction, identifies whether the type of the content application is a predetermined type, and when the type of the content application is the predetermined type, one or more inputs indicating the predetermined value
- the communication interface can be controlled to transmit a list containing signals to the server device.
- the processor by executing the at least one instruction, identifies whether the type of the content application is a predetermined type, and when the type of the content application is the predetermined type, the controller connects directly to the server device. Information for enabling connection and commands for controlling connection to the server device can be transmitted to the controller.
- the server device may include a communication interface, a memory storing at least one instruction, and a processor executing the at least one instruction stored in the memory.
- the processor may control the communication interface to transmit the first execution result content obtained by executing the content application to the display device.
- the processor may control the communication interface to receive a first input signal from the controller by executing the at least one instruction.
- the processor may identify whether the first input signal represents a predetermined value by executing the at least one instruction.
- the processor by executing the at least one instruction, determines that the first input signal represents the predetermined value, and sends the input signal to the display device to enable the display device to output a user interface screen.
- the communication interface can be controlled to transmit.
- the processor by executing the at least one instruction, identifies the first input signal as not representing the predetermined value, and generates a second execution result content obtained by executing the content application according to the input signal.
- the communication interface can be controlled to transmit to a display device.
- the processor controls the communication interface to receive a signal indicating that the display device is switched to a content playback control mode from the display device while the display device is operating in the menu mode by executing the at least one instruction. and recognizing that the display device operates in the content playback control mode upon receipt of the signal, and executing the content application according to the input signal received from the controller in accordance with the recognition, resulting in a third execution result content.
- the communication interface can be controlled to transmit to the display device.
- the processor by executing the at least one instruction, receives and stores a list including one or more input signals representing the predetermined value from the display device.
- a method of operating a display device includes receiving first execution result content obtained by executing a content application based on the input signal from a controller connected to a server device and providing a first input signal from the server device.
- An operation of displaying the first execution result content an operation of receiving an input signal from the controller indicating a predetermined value transmitted to the server device by the controller, from the server device, the predetermined value
- the operating method of the server device includes transmitting the first execution result content obtained by executing the content application to the display device, receiving a first input signal from the controller, and determining whether the first input signal represents a predetermined value. An operation of identifying, when the first input signal is identified as representing the predetermined value, an operation of transmitting the first input signal to the display device so that the display device can output a user interface screen, and As the first input signal is identified as not representing the predetermined value, transmitting a second execution result content obtained by executing the content application according to the input signal to the display device.
- FIG. 1 is a reference diagram for explaining operations of a server device and a display device according to various embodiments.
- Figure 2 shows an example of a system including a display device, a controller, and a server device according to an embodiment.
- Figure 4 shows an example of a flowchart of a method of operating a display device according to an embodiment.
- Figure 5 shows an example of a table that converts a controller input signal into a display device control signal according to an embodiment.
- Figure 6 shows an example of a flowchart of a method of operating a server device according to an embodiment.
- FIG. 8 is a reference diagram for explaining a method of operating a display device in a menu mode according to an embodiment.
- FIG. 9 is a reference diagram for explaining an example of a method of connecting a server device and a controller using a display device according to an embodiment.
- FIG. 11 is a reference diagram for explaining an example of a method of directly receiving a controller input signal from a controller to a display device in a menu mode of a display device, according to an embodiment.
- FIG. 12 shows an example of a flowchart of a method of operating a controller, a server device, and a display device for connecting a controller and a server device according to execution of content, according to an embodiment.
- FIG. 13 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- Figure 14 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- Figure 15 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- Figure 16 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- 17 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- Figure 18 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the term “user” refers to a person who controls the functions or operations of a computing device or electronic device using a control device, and may include a viewer, an administrator, or an installer.
- FIG. 1 is a reference diagram for explaining operations of a server device and a display device according to various embodiments.
- the display device 100 may transmit a request to execute the content application to the server device 300, receive a result screen according to the execution of the content application from the server device 300 according to the execution request, and display the received result screen 30 on the display.
- the controller 200 may transmit an operation command for controlling application execution result content displayed on the display device 100 to the server device 300 through a communication network or directly to the display device 100.
- the controller 200 disclosed in this disclosure can transmit an operation command according to a user operation input to the controller 200 to the server device 300 by communicating with the server device 300 using an Internet network.
- the user may operate the controller 200 to control the displayed content while viewing the content displayed on the display device 100, and the controller 200 may transmit a manipulation command according to the user's manipulation to the server device 300.
- the server device 300 may execute the application according to the content manipulation command received from the controller 200 and transmit the application execution result content to the display device 100. In this way, content control can be performed more quickly by transmitting the operation command from the controller 200 directly to the server device 300 rather than transmitting it to the server device 300 through the display device 100.
- the controller 200 is directly connected to the server device 300 and transmits an operation command
- a menu for controlling the display device 100 is executed on the display device 100
- the problem arises as to how to control the display device 100.
- there may be a situation where a user wants to control the display device 100 while watching content while controlling it using the display device 100.
- the display device 100 provides a menu for controlling the display device 100. It can operate in mode.
- the display device 100 does not receive an input signal directly from the controller 200. No. Accordingly, a method may be required to enable the display device 100 to receive a control signal for controlling the display device 100 in this menu mode.
- the display device 100 informs the server device 300 of information about an input signal having a predetermined value among the input signals used by the controller 200, and the server device 300 provides a predetermined value among the input signals received from the controller 200. If there is an input signal having , it can be identified and the display device 100 can be operated in menu mode. That is, if the input signal does not have a pre-specified value, the server device 300 may execute the content application based on the input signal from the controller 200 and transmit the execution result content to the display device 100. On the other hand, when the server device 300 receives an input signal having a predetermined value from the controller 200, the server device 300 may transmit the received input signal to the display device 100 as is. Then, the display device 100 may display the user interface screen 50 for controlling the display device 100 on the display based on the reception of the input signal having a predetermined value, so that the display device 100 can operate in the menu mode.
- the display device 100 receives an input signal from the controller 200 through the server device 300 while a user interface screen for controlling the display device 100 is displayed (menu mode), and operates based on the transmitted input signal. Control of the display device 100 can be performed.
- the display device 100 sends a control command instructing to transmit an input signal from the controller 200 directly to the display device 100 to the controller 200 while a user interface screen for controlling the display device 100 is displayed (menu mode).
- the display device 100 can be controlled by sending and receiving input signals directly from the controller 200.
- the display device 100 detects the end of the menu mode, that is, the end of the user interface screen, and transmits information indicating the end of the menu mode to the server device 300, thereby allowing the server device 300 to receive the input signal from the controller 200.
- the content application can be executed based on the input signal and the execution result content can be controlled to be transmitted.
- the display device 100 detects the end of the menu mode, that is, the end of the user interface screen, and transmits information indicating the end of the menu mode to the controller 200, thereby allowing the controller 200 to receive an input signal from the controller 200 to the server. It can be controlled to be transmitted to the device 300.
- the system may include a display device 100, a controller 200, and a server device 300 connected through a communication network.
- the display device 100 is a device that can display images or data according to a user's request, and may include a communication unit 110, a display 120, a memory 130, and a processor 140.
- the communication unit 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network where other devices are located. According to one embodiment, the communication unit 110 may communicate with the controller 200 according to short-range communication technology. Short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc. According to one embodiment, the communication unit 110 may communicate with the server device 300 according to the Internet protocol.
- the display 120 can output images or data processed by the display device 100.
- the memory 130 can store programs for processing and control of the processor 140 and can store data input to or output from the display device 100. Additionally, the memory 130 can store data necessary for the operation of the display device 100.
- Memory 130 is a flash memory type, hard disk type, multimedia card micro type, card type memory (e.g. SD or XD memory, etc.), RAM , Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk. It may include at least one type of storage medium.
- the processor 140 controls the overall operation of the display device 100.
- the processor 140 may perform the functions of the display device 100 described in the present disclosure by executing one or more instructions stored in the memory 130.
- the processor 140 may store one or more instructions in an internally provided memory and execute one or more instructions stored in an internally provided memory to control operations of the display device to be performed. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 130 provided inside the processor 140.
- the processor 140 may perform the operation of the display device 100 disclosed in this disclosure by executing one or more instructions stored in the memory 130.
- the processor 140 executes one or more instructions stored in the memory 130, thereby executing the content application based on the input signal from a controller connected to the server and providing the input signal, and transmits the execution result content obtained by executing the content application to the server.
- the communication interface can be controlled to receive from.
- the processor 140 may control the display to display the execution result content by executing one or more instructions stored in the memory 130.
- the processor 140 may control the communication interface to receive an input signal from the controller indicating a predetermined value from the server by executing one or more instructions stored in the memory 130.
- the processor 140 may execute one or more instructions stored in the memory 130 and display a user interface screen for controlling the display device upon receipt of an input signal representing the predetermined value.
- the processor 140 receives an input signal from the controller while displaying the user interface screen by executing one or more instructions stored in the memory 130 and controls the display device based on the input signal. You can perform the following actions.
- the processor 140 executes one or more instructions stored in the memory 130 to receive an input signal from the controller through the server or directly from the controller while displaying the user interface screen.
- Communication interface can be controlled.
- the processor 140 executes one or more instructions stored in the memory 130 to terminate display of the user interface screen according to an input signal for terminating the user interface screen while displaying the user interface screen. You can control the display.
- the processor 140 executes one or more instructions stored in the memory 130, thereby transmitting to the server a signal indicating that the display device operates in a content playback control mode upon termination of the user interface screen. You can control the interface.
- the processor 140 executes one or more instructions stored in the memory 130 to display the content according to an input signal received from the controller according to transmission of a signal indicating that the display device operates in a content playback control mode.
- the communication interface can be controlled to receive execution result content obtained by executing the application from the server.
- the processor 140 may identify whether the type of the content application is a predetermined type by executing one or more instructions stored in the memory 130.
- the processor 140 executes one or more instructions stored in the memory 130 to create a list containing one or more input signals representing the predetermined value according to the type of the content application being the predetermined type.
- the communication interface can be controlled to transmit to a server.
- the processor 140 executes one or more instructions stored in the memory 130 to identify whether the type of the content application is a predetermined type, and if the type of the content application is the predetermined type, the controller Information to enable direct connection to the server and a command to control connection to the server may be transmitted to the controller.
- the display device 100 may be any type of device that performs a function including a processor and memory.
- the display device 100 may be a fixed or portable device.
- the display device 100 may represent a device that has a display and can display image content, video content, game content, graphic content, etc.
- the display device 100 can output or display images or content received from the server device 300.
- the display device 100 may include, for example, televisions such as network TVs, smart TVs, Internet TVs, web TVs, IPTVs, computers such as desktops, laptops, tablets, smartphones, cellular phones, game players, music players, video players, medical devices, etc. It may include various types of electronic devices that can receive and output content, such as various smart devices such as equipment, home appliances, etc.
- the display device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, sink device, electronic device, computing device, etc.
- the block diagram of the display device 100 shown in FIG. 2 is a block diagram for one embodiment.
- Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 100 that is actually implemented. For example, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components.
- the functions performed by each block are for explaining the embodiments, and the specific operations or devices do not limit the scope of the present invention.
- controller 200 will be described.
- the communication unit 210 may include one or more modules that enable wireless communication between the controller 200 and a wireless communication system or between the controller 200 and a network where other devices are located. According to one embodiment, the communication unit 210 may perform communication with the display device 100 according to short-range communication technology. Short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc. According to one embodiment, the communication unit 210 may communicate with the server device 300 according to the Internet protocol.
- the user input unit 220 may be any type of interface means capable of receiving user input.
- the user input unit 220 is arranged in a part of the controller 200 and includes an operation button capable of receiving a user's input, a touch-sensitive display configured to detect a touch input, a microphone capable of receiving a user's voice speech input, etc. may include.
- the memory 230 can store programs for processing and control of the processor 240, and can store data input to or output from the controller 200.
- Memory 230 is a flash memory type, hard disk type, multimedia card micro type, card type memory (e.g. SD or XD memory, etc.), RAM , Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk. It may include at least one type of storage medium.
- Processor 240 controls the overall operation of controller 200.
- the processor 240 may perform the functions of the controller 200 described in the present disclosure by executing one or more instructions stored in the memory 230.
- the processor 240 may store one or more instructions in an internally provided memory and execute one or more instructions stored in an internally provided memory to control the above-described operations to be performed. That is, the processor 240 may perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 230 provided inside the processor 240.
- the processor 240 may perform a communication connection with the display device 100 using short-range wireless communication technology by executing one or more instructions stored in the memory 230.
- Short-range wireless communication technology may include Bluetooth communication technology or Wi-Fi Direct technology.
- the processor 240 receives information for a wireless communication connection from the display device 100 by executing one or more instructions stored in the memory 230, and performs a wireless communication connection using the received information for the wireless communication connection. You can access access point 70 by doing this.
- information for a wireless communication connection is information for connecting to an access point and may include an access point ID and a password for accessing the access point.
- the processor 240 receives information for connecting to the server device 300 from the display device 100 by executing one or more instructions stored in the memory 230, and uses the information received for connecting to the server device 300 to connect to the server.
- the server device 300 connection information may include a URL for accessing the server device 300, user account information for connecting to the server device 300, and a user ID or password.
- the processor 240 may receive a list of input signals representing predetermined values from the display device 100 and transmit the received input signal list to the server device 300 by executing one or more instructions stored in the memory 230. .
- the processor 240 may transmit an input signal corresponding to the user input received through the user input unit 220 to the server device 300 or the display device 100 by executing one or more instructions stored in the memory 230.
- the processor 240 executes one or more instructions stored in the memory 230, receives information indicating the menu mode from the display device 100, and sends an input signal corresponding to the user input received through the user input unit 220 to the display device. You can send it as 100.
- the processor 240 receives information indicating the end of the menu mode from the display device 100 by executing one or more instructions stored in the memory 230 and sends an input signal corresponding to the user input received through the user input unit 220. It can be transmitted to the server device 300.
- the controller 200 may be any type of device that performs a function including a processor and memory.
- the controller 200 may include various electronic devices such as remote controllers, game controllers, and smartphones.
- the server device 300 will now be described.
- the server device 300 may include a communication unit 310, a memory 320, and a processor 330. However, the server device 300 may be implemented with more components than those shown, and is not limited to the above-described example. For example, the server device 300 may be equipped with a separate image processing unit for image processing of application images executed on the server device 300.
- the communication unit 310 may include one or more modules that enable wireless communication between the server device 300 and a wireless communication system or between the server device 300 and a network where other devices are located. According to one embodiment, the communication unit 310 may communicate with the display device 100 according to the Internet protocol. According to one embodiment, the communication unit 310 may communicate with the controller 200 according to the Internet protocol.
- the memory 320 can store programs for processing and control of the processor 330 and can store data input to or output from the server device 300.
- Memory 320 is a flash memory type, hard disk type, multimedia card micro type, card type memory (e.g. SD or XD memory, etc.), RAM , Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk. It may include at least one type of storage medium.
- the processor 330 controls the overall operation of the server device 300.
- the processor 330 may perform the functions of the server device 300 described in the present disclosure by executing one or more instructions stored in the memory 320.
- the processor 330 may store one or more instructions in an internally provided memory and execute one or more instructions stored in an internally provided memory to control the above-described operations to be performed. That is, the processor 330 may perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 320 provided inside the processor 330.
- the processor 330 may receive a request to execute a content application from the display device 100 by executing one or more instructions stored in the memory 320, and transmit content as a result of executing the requested content application to the display device 100. there is.
- the processor 330 may receive an input signal list representing a predetermined value from the display device 100 or the controller 200 by executing one or more instructions stored in the memory 320 and store the received input signal list.
- the processor 330 receives information indicating the content playback control mode of the display device 100 from the display device 100 by executing one or more instructions stored in the memory 320, and displays the content based on the input signal received from the controller 200.
- the application can be executed, and the execution result content can be transmitted to the display device 100.
- the processor 330 executes one or more instructions stored in the memory 320, so that when the input signal received from the controller 200 represents a predetermined value, the processor 330 can transmit the input signal representing the predetermined value to the display device 100 as is. there is.
- the processor 330 receives information indicating the menu mode of the display device 100 from the display device 100 by executing one or more instructions stored in the memory 320 and directly transmits the input signal received from the controller 200 to the display device 100. It can be delivered.
- the processor 330 may execute one or more instructions stored in the memory 320 and control the communication interface to transmit the execution result content obtained by executing the content application to the display device.
- the processor 330 may control the communication interface to receive an input signal from the controller by executing one or more instructions stored in the memory 320.
- the processor 330 may identify whether the input signal represents a predetermined value by executing one or more instructions stored in the memory 320.
- the processor 330 executes one or more instructions stored in the memory 320, and as the input signal is identified as not representing the predetermined value, the execution result content obtained by executing the content application according to the input signal
- the communication interface can be controlled to transmit to the display device.
- the processor 330 executes one or more instructions stored in the memory 320 to transmit an input signal received from the controller to the display device while the display device operates in a menu mode that outputs the user interface screen.
- the communication interface can be controlled to do so.
- the processor 330 executes one or more instructions stored in the memory 320, thereby receiving a signal from the display device indicating that the display device is operating in a content playback control mode while the display device is operating in the menu mode.
- the communication interface can be controlled to receive.
- the processor 330 may recognize that the display device operates in the content playback control mode upon reception of the signal by executing one or more instructions stored in the memory 320.
- the processor 330 executes one or more instructions stored in the memory 320, and transmits the execution result content obtained by executing the content application according to the input signal received from the controller according to the recognition to the display device.
- the communication interface can be controlled.
- the processor 330 may receive and store a list including one or more input signals representing the predetermined value from the display device by executing one or more instructions stored in the memory 320.
- the block diagram of the server device 300 shown in FIG. 2 is a block diagram for one embodiment.
- Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the server device 300 that is actually implemented. For example, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components.
- the functions performed by each block are for explaining the embodiments, and the specific operations or devices do not limit the scope of the present invention.
- Figure 3 is an example of a block diagram of a display device according to an embodiment.
- the display device 100 may include an image processing unit 150, an audio processing unit 160, an audio output unit 170, a receiving unit 180, and a sensing unit 190, in addition to a communication unit 110, a display 120, a memory 130, and a processor 140.
- the communication unit 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network where other electronic devices are located.
- the communication unit 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-range communication module 113.
- the mobile communication module 111 transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network.
- the wireless signal may include various types of data based on voice call signals, video call signals, or text/multimedia message transmission and reception.
- the display 120 can display the video signal received from the server device 300 on the screen.
- the memory 130 can store programs related to the operation of the display device 100 and various data generated during the operation of the display device 100.
- Memory 130 can store at least one instruction. Additionally, the memory 130 may store at least one instruction executed by the processor 140. Additionally, the memory 130 may store at least one program executed by the processor 140. Additionally, the memory 130 may store an application for providing a certain service.
- the memory 130 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among disks and optical disks.
- a flash memory type e.g., a hard disk type
- a multimedia card micro type e.g., SD or XD memory, etc.
- RAM Random Access Memory
- SRAM Static Random Access Memory
- ROM Read-Only Memory
- EEPROM Electrically Erasable Programmable Read-Only Memory
- PROM Programmable Read-Only Memory
- magnetic memory magnetic It may include at least one type of storage medium among disks and optical disks.
- the processor 140 controls the overall operation of the display device 100.
- the processor 140 may perform the functions of the display device 100 described in the present disclosure by executing one or more instructions stored in the memory 130.
- the processor 140 may store one or more instructions in an internally provided memory and execute one or more instructions stored in an internally provided memory to control operations of the display device to be performed. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 130 provided inside the processor 140.
- the audio processing unit 160 may convert the audio signal received from the receiving unit 180 or the communication unit 110 into an analog audio signal and output it to the audio output unit 170 under the control of the processor 140.
- the audio output unit 170 may output audio (eg, voice, sound) input through the communication unit 110 or the receiver 180. Additionally, the audio output unit 170 may output audio stored in the memory 130 under the control of the processor 140.
- the audio output unit 170 may include at least one or a combination of a speaker, a headphone output terminal, and a Sony/Philips Digital Interface (S/PDIF) output terminal.
- S/PDIF Sony/Philips Digital Interface
- the receiver 180 receives video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the display device 100 under the control of the processor 140. can do.
- the receiving unit 180 includes one of an HDMI port (High-Definition Multimedia Interface port, 181, a component jack, 182), a PC port, 183, and a USB port, 184, or one or more
- the receiver 180 may further include DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link).
- DP DisplayPort
- Thunderbolt Thunderbolt
- MHL Mobile High-Definition Link
- the detection unit 190 detects the user's voice, user's image, or user interaction, and may include a microphone, a camera unit, and an optical receiver.
- the microphone receives the user's utterance.
- the microphone can convert the received voice into an electrical signal and output it to the processor 140.
- the user voice may include, for example, a voice corresponding to a menu or function of the display device 100.
- the camera unit may receive images (eg, consecutive frames) corresponding to the user's motion, including gestures, within the camera recognition range.
- the processor 140 can use the received motion recognition result to select a menu displayed on the display device 100 or perform control corresponding to the motion recognition result.
- the optical receiver receives optical signals (including control signals) received from an external control device.
- the light receiver may receive an optical signal corresponding to a user input (eg, touch, press, touch gesture, voice, or motion) from the control device.
- a control signal may be extracted from the received optical signal under the control of the processor 140.
- the memory 130 can store programs related to the operation of the display device 100 and various data generated during the operation of the display device 100.
- the processor 140 controls the overall operation of the display device 100 and signal flow between internal components (not shown) of the display device 100, and performs the function of processing data. When there is a user input or a preset and stored condition is satisfied, the processor 140 can execute an operating system (OS) and various applications stored in the memory 130.
- OS operating system
- the processor 140 may include a graphics processor (Graphic Processing Unit, not shown) for graphics processing corresponding to video.
- the graphics processing unit uses an arithmetic unit (not shown) and a rendering unit (not shown) to create a screen containing various objects such as icons, images, and text.
- the calculation unit uses the user interaction detected through the detection unit 190 to calculate attribute values such as coordinates, shape, size, color, etc. for each object to be displayed according to the layout of the screen.
- the rendering unit generates screens with various layouts including objects based on the attribute values calculated by the calculation unit.
- the processor 140 executes one or more instructions to receive execution result content obtained by executing a content application based on the input signal from a controller connected to the server 200 and providing an input signal from the server.
- Communication interface can be controlled.
- the processor 140 may control the display to display the execution result content received from the server by executing one or more instructions.
- the processor 140 may control the communication interface to receive an input signal from the controller indicating a predetermined value from the server by executing one or more instructions.
- the processor 140 may display a user interface screen for controlling the display device according to reception of an input signal representing the predetermined value by executing one or more instructions.
- the processor 140 receives an input signal from the controller while displaying the user interface screen by executing one or more instructions, and performs an operation of controlling the display device based on the input signal. You can.
- the processor 140 may control the display to end display of the user interface screen according to an input signal for ending the user interface screen while displaying the user interface screen by executing one or more instructions. there is.
- the processor 140 may control the communication interface to transmit a signal indicating that the display device operates in a content playback control mode to the server upon termination of the user interface screen by executing one or more instructions. there is.
- the processor 140 executes one or more instructions, thereby transmitting a signal indicating that the display device operates in a content playback control mode, and executing the content application according to an input signal received from the controller.
- the communication interface can be controlled to receive execution result content from the server.
- the processor 140 executes one or more instructions to identify whether the type of the content application is a predetermined type, and if the type of the content application is the predetermined type, one indicating the predetermined value.
- the communication interface can be controlled to transmit a list containing the above input signals to the server.
- the processor 140 executes one or more instructions to identify whether the type of the content application is a predetermined type, and when the type of the content application is the predetermined type, the controller directly sends the content to the server. Information for connection and a command to control connection to the server may be transmitted to the controller.
- Figure 4 shows an example of a flowchart of a method of operating a display device according to an embodiment.
- the display device 100 may receive content obtained by executing a content application on the server device 300 from the server device 300.
- the display device 100 transmits a request to execute a content application to the server device 300, and the server device 300 may execute the content application according to the execution request received from the display device 100. Additionally, the server device 300 may transmit content to the display device 100 as a result of executing the content application.
- the display device 100 may provide information about the content application and an item or interface to request execution of the content application.
- the display device 100 may transmit a request to execute the content application requested by the user to the server device 300.
- the server device 300 may execute a content application requested to be executed and transmit an image or screen resulting from execution to the display device 100.
- the server device 300 executes the game application and displays images or screens that appear as a result of execution, such as a prequel image or intro screen that initially appears when the game content is executed, and information about the game content.
- the captured screen, etc. can be transmitted to the display device 100.
- the display device 100 may receive execution result content obtained by executing a content application based on an input signal from the controller 200 from the server device 300 and display the received execution result content.
- the controller 200 may connect to the server device 300 through a wireless communication network and transmit an input signal according to user manipulation to the server device 300.
- the server device 300 when the server device 300 receives an input signal from the controller 200, the server device 300 may control the execution of a content application using the received input signal and transmit the obtained execution result content to the display device 100.
- the display device 100 may display content resulting from the execution of a content application received from the server device 300.
- the user may manipulate user input using the controller 200 to play the game content.
- the controller 200 may perform an input signal corresponding to a user input, for example, a user operation to move a character of game content, and may transmit an input signal corresponding to the character movement to the server device 300 accordingly.
- the server device 300 can execute the content application by performing an operation to cause the character to move based on the input signal corresponding to the character movement, and transmit the resulting content, that is, the screen on which the character is moved, to the display device 100.
- the display device 100 may display a user interface screen for controlling the display device 100 as it receives an input signal from the controller representing a predetermined value from the server device 300.
- the display device 100 may receive an input signal from a controller indicating a predetermined value from the server device 300. For example, when the display device 100 receives, from the server device 300, a signal representing a predetermined value, that is, “aaa1” among the controller input signals as shown in FIG. 5, it receives the input signal representing the predetermined value. can be identified as having been received.
- the server device 300 when the server device 300 receives an input signal from the controller 200 and the input signal does not represent a predetermined value, the server device 300 executes the content application based on the input signal and sends the execution result screen to the display device 100. However, if this input signal represents a predetermined value, the server device 300 may transmit the input signal representing this predetermined value to the display device 100 as is.
- the display device 100 may display a user interface screen for controlling the display device 100 as it receives an input signal representing a predetermined value from the server device 300.
- the user interface screen for controlling the display device 100 may display a menu screen for controlling components of the display device 100 that can be adjusted by the user.
- the menu screen may include one or more items or buttons for controlling the sound volume of the display device 100, the brightness of the display, or audio input/output interfaces.
- the display device 100 may be controlled based on an input signal from the controller while the display device 100 displays the user interface screen.
- the display device 100 may receive an input signal from a controller while displaying a user interface screen, and control the display device 100 based on the received input signal.
- the display device 100 may receive an input signal from the controller 200 directly from the controller 200 while displaying a user interface screen, or may receive an input signal from the controller 200 through the server device 300.
- the user can use the controller 200 to increase the volume of the display device 100 through the user interface screen, and the controller 200 directly transmits an input signal corresponding to the volume increase operation to the display device 100.
- the server device 300 may transmit the input signal received from the controller 200 to the display device 100.
- the display device 100 that receives the input signal from the server device 300 or the controller 200 can convert the input signal into a display device control signal and control the display device 100 using the converted display device control signal.
- the display device 100 may convert the input signal from the controller 200 using a controller input signal-display device control signal conversion table.
- Figure 5 shows an example of a table that converts a controller input signal into a display device control signal according to an embodiment.
- the controller input signal-display device control signal conversion table 500 which can convert the input signal from the controller 200 into a display device control signal used to control the display device, contains the values of the input signal from the controller 200 and the values of the display device control signal. It can represent the mapping table of . Referring to FIG. 5, each of the input signal values aaa1, aaa2, aaa3, aaa4, aaa5, and aaa6 of the controller 200 can be mapped to each of the display device control signal values d1, d2, d3, d4, d5, and d6. there is.
- the display device 100 converts the input signal from the controller 200 using the conversion table shown in FIG. 5 to control the display device while the display device 100 operates in the menu mode for controlling the display device, thereby converting the input signal to the controller.
- the display device can be controlled by converting the signal into a display device control signal.
- a method of operating a display device may include receiving execution result content obtained by executing a content application based on the input signal from a controller connected to a server and providing an input signal from the server. there is.
- a method of operating a display device may include displaying the execution result content.
- a method of operating a display device may include receiving an input signal from the controller indicating a predetermined value from the server.
- a method of operating a display device may include displaying a user interface screen for controlling the display device upon receipt of an input signal representing the predetermined value.
- a method of operating a display device may include receiving an input signal from the controller while displaying the user interface screen, and controlling the display device based on the input signal.
- a method of operating a display device may include receiving an input signal from the controller through the server or directly from the controller while displaying the user interface screen.
- a method of operating a display device may include an operation of terminating display of the user interface screen according to an input signal terminating the user interface screen while displaying the user interface screen.
- a method of operating a display device may include transmitting a signal indicating that the display device operates in a content playback control mode to the server upon termination of the user interface screen.
- a method of operating a display device includes execution result content obtained by executing the content application according to an input signal received from the controller according to transmission of a signal indicating that the display device operates in a content playback control mode. It may include an operation of receiving from the server.
- a method of operating a display device may include identifying whether the type of the content application is a predetermined type.
- a method of operating a display device may include transmitting a list including one or more input signals representing the predetermined value to the server when the type of the content application is the predetermined type. You can.
- a method of operating a display device may include identifying whether the type of the content application is a predetermined type.
- a method of operating a display device includes providing information for allowing the controller to directly connect to the server and a command for controlling connection to the server, as the type of the content application is the predetermined type. It may include an operation to transmit to the controller.
- Figure 6 shows an example of a flowchart of a method of operating a server device according to an embodiment.
- the server device 300 may transmit the execution result content obtained by executing the content application to the display device 100.
- the server device 300 may receive a request to execute a content application from the display device 100 and transmit the execution result content obtained by executing the content application according to this execution request to the display device 100.
- the server device 300 may receive an input signal from the controller 200 and identify whether the received input signal represents a predetermined value.
- the server device 300 may receive and store a list of input signals representing predetermined values from the display device 100, or may receive and store a list of input signals representing predetermined values from the controller 200.
- the server device 300 may receive and store the device controller input signal ⁇ aaa1> as a list of input signals representing predetermined values.
- ⁇ aaa1> may be the value of a signal corresponding to pressing the home key among one or more keys provided in the controller 200.
- the server device 300 when the server device 300 receives an input signal from the controller 200, it can identify whether the value of the received input signal represents a predetermined value.
- the server device 300 determines whether the input signal from the controller 200 represents a predetermined value, and if it represents a predetermined value, proceeds to operation 640. If it does not represent a predetermined value, it may proceed to operation 650. there is.
- the server device 300 may transmit the input signal to the display device 100 to cause the display device 100 to operate in the menu mode.
- the server device 300 may transmit the input signal received from the controller 200 to the display device 100 as is. Then, the display device 100 that receives the input signal representing the predetermined value can display a user interface screen for controlling the display device 100. In this way, the mode for controlling the display device 100 by displaying a user interface screen may be referred to as a menu mode.
- the server device 300 may use the input signal from the controller 200 to control execution of the content application. That is, the server device 300 may perform an operation for executing a content application using an input signal from the controller 200 and transmit the execution result content obtained by performing the operation to the display device 100.
- a mode in which the display device 100 displays content from the server device 300 and playback of the content displayed on the display device 100 is controlled based on an input signal from the controller 200 may be referred to as a content playback control mode.
- a method of operating a server device may include transmitting execution result content obtained by executing a content application to a display device.
- a method of operating a server device may include receiving an input signal from a controller.
- a method of operating a server device may include identifying whether the input signal represents a predetermined value.
- the operating method of the server device includes transmitting execution result content obtained by executing the content application according to the input signal to the display device as the input signal is identified as not representing the predetermined value.
- a method of operating a server device may include transmitting an input signal received from the controller to the display device while the display device operates in a menu mode that outputs the user interface screen.
- a method of operating a server device may include receiving a signal indicating that the display device operates in a content playback control mode from the display device while the display device operates in the menu mode. there is.
- a method of operating a server device may include recognizing that the display device operates in the content playback control mode upon reception of the signal.
- a method of operating a server device may include transmitting, based on the recognition, execution result content obtained by executing the content application according to an input signal received from the controller to the display device.
- FIG. 7 is a reference diagram for explaining an operation method of the display device 100 in a content playback control mode according to an embodiment.
- the display device 100 may receive and display content 30 as a result of execution of an application executed from the server device 300. If the user wishes to control execution of content displayed on the display device 100, the user may operate one or more input keys or input buttons provided on the controller 200.
- the controller 200 may transmit an input signal corresponding to the user's manipulation input to the server device 300.
- the server device 300 which receives the input signal from the controller 200 in this way, can execute the application using the input signal from the controller 200 in the content playback control mode of the display device 100.
- the server device 300 may receive a signal from the display device 100 indicating that the display device 100 is in a content playback control mode. For example, if content controllable by a user is in the foreground layer among one or more layers output on the display, the display device 100 may identify the content playback control mode of the display device.
- the server device 300 may perform calculations for executing an application using an input signal from the controller 200, and transmit execution result content generated according to the results of these calculations to the display device 100.
- FIG. 8 is a reference diagram for explaining a method of operating a display device in a menu mode according to an embodiment.
- a user may want to change the settings of the display device 100 while playing content that can be run and controlled by the user through the display device 100. For example, when adjusting the sound of the display device 100, adjusting the display screen brightness, or changing the language, it is necessary to display a menu screen for changing these settings. At this time, the user can select and press a key corresponding to a predetermined value through the controller 200 so that an input signal with a predetermined value is transmitted to the server device 300.
- the server device 300 may directly transmit the input signal to the display device 100 instead of performing calculations for application execution using the input signal.
- the display device 100 which has received an input signal representing a predetermined value from the server device 300, may output a user interface screen 50 for controlling settings of the display device 100 as it identifies that the input signal represents a predetermined value.
- the display device 100 outputs a user interface screen 50 for controlling the settings of the display device 100, allowing the settings of the display device 100 to be controlled according to user input, thereby changing the operation mode of the display device 100 to the menu mode. can be identified.
- the display device 100 may transmit a signal indicating that the operation mode of the display device 100 is a menu mode to the server device 300.
- the server device 300 receives an input signal from the controller 200 while the operation mode of the display device 100 is the menu mode, the server device 300 can transmit the input signal from the controller 200 to the display device 100 as is.
- the display device 100 may transmit a signal indicating that the operation mode of the display device 100 is a menu mode to the controller 200.
- the controller 200 may transmit an input signal corresponding to the user input to the display device 100 instead of the server device 300.
- FIG. 9 is a reference diagram for explaining an example of a method of connecting a server device and a controller using a display device according to an embodiment.
- the display device 100 may transmit a content application execution request 910 to the server device 300.
- the display device 100 may transmit a request for execution of the content application selected by the user to the server device 300.
- the display device 100 may obtain information about the content application requested to be executed.
- Information about the content application requested to be executed may be stored in the display device 100 itself or may be received from the server device 300.
- Information about the content application may include information indicating whether this application is a type of direct connection between server controllers.
- the display device 100 when it identifies the content application as a type that directly connects server controllers, it may perform an operation to enable the controller 200 and the server 300 to be directly connected. That is, the display device 100 can transmit to the controller 200 the information necessary for the server connection operation of the controller 200 and the server connection induction control command 920.
- Information required for the server connection operation may include access point connection information to enable the controller 200 to first access the wireless Internet and server connection information to enable the controller 200 to access the server through the wireless Internet.
- Access point connection information may include access point identification information and a password for connecting to the access point.
- Server connection information may include the URL of the server device 300 or a password for accessing the server device 300.
- the server connection inducing control command may represent a control command that induces the controller 200 to directly connect to the server device 300 using access point connection information and server connection information.
- the display device 100 when the display device 100 identifies the content application as a type that directly connects server controllers, it may transmit an input signal list 940 indicating a predetermined value to the server device 300.
- the purpose of transmitting the input signal list 940 representing these predetermined values is to enable the display device 100 to switch from the content playback control mode to the menu mode.
- the controller 200 may perform an operation to connect to the server device 300 according to a server connection induction control command received from the display device 100.
- the controller 200 may first connect to the wireless Internet using access point connection information, and may also perform operation 930 of connecting to the server device 300 using server connection information.
- the controller 200 when the controller 200 receives a user input, it can transmit the corresponding input signal 950 to the server device 300, and the server device 300 executes a content application based on the input signal received from the controller 200, and the content application
- the execution result screen 960 can be transmitted to the display device 100.
- the display device 100 can enable the controller 200 to directly connect to the server device 300 and transmit the input signal of the controller 200 directly to the server device 300.
- FIG. 10 is a reference diagram for explaining an example of a method of receiving a controller input signal through a server device in a menu mode of a display device, according to an embodiment.
- the display device 100 may transmit information 1010 indicating the content playback control mode to the server device 300.
- the controller 200 may transmit an input signal 1020 corresponding to the user input to the server device 300.
- the server device 300 identifies whether the input signal received from the controller 200 represents a predetermined value, and if it does not represent a predetermined value, performs an operation for executing the application using the input signal from the controller 200 and displays a content execution result screen. 1030 can be transmitted to the display device 100.
- the server device 300 may transmit the input signal 1040 representing the predetermined value to the display device 100 as is.
- the display device 100 may output a user interface screen for controlling the display device and may also transmit information 1050 indicating that the display device 100 is in a menu mode to the server device 300.
- the server device 300 may recognize that the display device 100 is in menu mode.
- the server device 300 may transmit the input signal 1060 from the controller 200 to the display device 100 as is.
- the display device 100 can control the display device based on an input signal from the controller 200. That is, the display device 100 can convert an input signal from the controller 200 into a display device control signal and perform an operation corresponding to the converted display device control signal.
- the display device 100 can identify that the menu mode ends and the content playback control mode starts. In this case, the display device 100 may transmit information indicating the content playback control mode to the server device 300.
- FIG. 11 is a reference diagram for explaining an example of a method of directly receiving a controller input signal from a controller to a display device in a menu mode of a display device, according to an embodiment.
- the display device 100 may transmit information 1110 indicating the content playback control mode to the server device 300.
- the controller 200 may transmit an input signal 1120 corresponding to the user input to the server device 300.
- the server device 300 identifies whether the input signal received from the controller 200 represents a predetermined value, and if it does not represent a predetermined value, performs an operation for executing the application using the input signal from the controller 200 and displays a content execution result screen. 1130 can be transmitted to the display device 100.
- the server device 300 may transmit the input signal 1140 representing the predetermined value to the display device 100 as is.
- the display device 100 may output a user interface screen for controlling the display device and may also transmit information 1150 indicating that the display device 100 is in a menu mode to the controller 200.
- the controller 200 can recognize that the display device 100 is in menu mode.
- the controller 200 may directly transmit an input signal 1160 corresponding to a user input to the display device 100 while the display device 100 is in a menu mode.
- the display device 100 When the display device 100 receives an input signal from the controller 200, it can control the display device based on the input signal from the controller. That is, the display device 100 may convert the input signal of the controller 200 into a display device control signal and perform operation 1170 corresponding to the converted display device control signal.
- the display device 100 may recognize that the menu mode ends and the content playback control mode begins. Then, the display device 100 may transmit information 1180 indicating the end of the menu mode to the controller 100 to notify the end of the menu mode.
- the controller 200 may transmit an input signal corresponding to the user input back to the server device 300.
- Figure 12 shows an example of a flowchart of a method of operating a controller, a server device, and a display device for connecting a controller and a server according to content execution, according to an embodiment.
- the display device 100 may transmit a content application execution request to the server device 300.
- the display device 100 may display items for starting execution of a content application, and as the user receives an input for selecting one item from among the displayed items, the display device 100 displays a display device corresponding to the selected item.
- a request to execute a content application may be transmitted to the server device 300.
- the server device 300 may execute the requested content application according to a content application execution request received from the display device 100.
- the server device 300 may transmit the content application screen resulting from application execution to the display device 100.
- the display device 100 may obtain attribute information of the content application requested to be executed.
- the display device 100 may store attribute information of a content application requested to be executed.
- the display device 100 may obtain attribute information of a content application from the meta information of the application.
- the display device 100 may place a field in the application database as meta information about each application as to whether it is a type directly connected between server controllers, and store the value in the field at the time of installation or update for each application. .
- the display device 100 may obtain attribute information of the application by requesting attribute information of the content application to the server device 300 and receiving the attribute information from the server device 300.
- the attribute information of the content application requested to be executed may include information indicating whether the content application is a type that directly connects between server controllers. In the case of a content application that connects directly between server controllers, it can indicate that an input signal for controlling the execution of the content application can be directly transmitted from the controller to the server.
- the display device 100 may determine whether the application requested to be executed is a content application of a prespecified type.
- the display device 100 may determine whether the application requested to be executed, as an example of a pre-designated type, is a type directly connected between server controllers.
- the display device 100 may obtain information about whether the application requested to be executed is a type directly connected between server controllers from the meta information of the application.
- the meta information of these applications may be stored when the application is installed or updated on the display device 100.
- an application installed on the display device 100 may mean that a collection of one or more instructions and data for starting execution of an application running on the server is installed on the display device.
- the display device 100 may obtain information about whether the application requested to be executed is a type directly connected between server controllers by requesting and receiving information from the server device 300.
- operation 1290 may be performed.
- the display device 100 may control the execution of the content application by receiving an input from the controller 200 and transmitting the received input signal of the controller 200 to the server device 300.
- operation 1250 may be performed.
- the display device 100 may transmit content playback control mode information and an input signal list indicating predetermined values.
- the display device 100 may transmit content playback control mode information indicating that the display device is in the content playback control mode to the server device 300.
- the display device 100 may transmit a list of input signals representing predetermined values.
- This input signal list has one or more predetermined values in order to request that the server device 300 transmit the input signal with this predetermined value to the display device 100 as is when the input signal with this predetermined value is received from the controller 200. May include input signals.
- the display device 100 can transmit an input signal list including the input signal with one predetermined value.
- the input signal list may include ⁇ aaa1> as an input signal representing a predetermined value.
- the fact that the display device 100 transmits the content playback control mode information and the input signal list representing the predetermined value in operation 1250 does not necessarily mean that they are transmitted simultaneously, and of course, they may be transmitted simultaneously or at different times.
- the server device 300 may store content playback control mode information received from the display device 100 and an input signal list indicating predetermined values.
- the display device is installed to enable direct connection between the server and the controller.
- 100 can transmit a server connection induction control command to the controller 200 along with the information necessary for server connection operation.
- Information required for the server connection operation may include access point connection information to enable the controller 200 to first access the wireless Internet and server connection information to enable the controller 200 to access the server through the wireless Internet.
- Access point connection information may include access point identification information and a password for connecting to the access point.
- Server connection information may include the URL of the server device 300 or a password for accessing the server device 300.
- the server connection inducing control command may represent a control command that induces the controller 200 to directly connect to the server device 300 using access point connection information and server connection information.
- the controller 200 may perform an operation to connect to the server using information required for the server connection operation received from the display device 100.
- the controller 200 may perform an operation to connect to the server device 300 according to a server connection induction control command received from the display device 100.
- the controller 200 can first connect to the wireless Internet using access point connection information and then perform a connection operation to the server device 300 using server connection information.
- the server device 300 directly receives the input signal from the controller 200 and receives the received input signal.
- the result of executing the content application according to the signal may be transmitted to the display device 100.
- the display device 100 may receive an input signal for controlling the display device through the server device 300 or directly from the controller 200.
- the display device 100 receives a signal from the server 300 in both the content playback control mode and the menu mode of the display device will be described with reference to FIGS. 13 to 15, and in the menu mode of the display device, the display device 100 receives a signal directly from the controller 200.
- An example of receiving a signal will be described with reference to FIGS. 16 to 18.
- FIG. 13 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the controller 200 may transmit an input signal according to user manipulation to the server device 300. While the display device 100 displays content based on the results of application execution from the server device 300, the user may operate the controller 200 to control execution of content displayed on the display device 100. For example, in order to manipulate the forward movement of a specific character in the content displayed on the display device 100, the user may input a manipulation corresponding to the forward motion using a button, key, or dial provided on the controller 200, and the controller 200 accordingly allows the user to move forward. An input signal corresponding to the manipulation input may be transmitted to the server device 300.
- the server device 300 may receive an input signal from the controller 200 and determine whether the display device 100 is in the content playback control mode.
- the server device 300 may receive and store information indicating whether the display device 100 is in a content playback control mode in advance from the display device 100.
- the process can proceed to ⁇ A>.
- operation 1330 may be performed.
- the server device 300 may determine whether the input signal represents a pre-specified value.
- the server device 300 may receive and store an input signal list representing pre-designated values from the display device 100. If the input signal represents a pre-specified value, proceed to ⁇ A>, and if the input signal does not represent a pre-specified value, proceed to operation 1340.
- the server device 300 may execute the content application based on the input signal and transmit the execution result screen to the display device 100. there is.
- the display device 100 may receive an application execution result screen from the server device 300 and display the received execution result screen.
- the execution result screen displayed on the display device 100 shows the forward motion of the specific character. It may include images that were performed.
- Figure 14 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the process may proceed to ⁇ A>.
- the server device 300 may transmit the input signal of the controller to the display device 100 as is.
- ⁇ A> There are two situations that can proceed with ⁇ A>, that is, when the display device 100 is not in the content playback control mode, and when the display device 100 is in the menu mode, the controller input signal is directly transmitted to the display device 100 to be used to control the display device.
- the controller input signal is directly transmitted to the display device 100 in order to enable the display device 100 to enter the menu mode.
- the display device 100 may determine whether the input signal of the controller received from the server device 300 represents a predetermined value. As a result of the determination, if the input signal of the controller does not represent a pre-designated value, the process proceeds to operation 1460. If the input signal indicates a pre-designated value, the process proceeds to operation 1430.
- the display device 100 may output a user interface screen for controlling the display device as the input signal from the controller rotor indicates a predetermined value.
- the user interface screen may include a quick panel, etc.
- the display device 100 may transmit information indicating that the operation mode of the display device is the menu mode to the server device 300.
- the server device 300 may receive information received from the display device 100 and store information indicating that the display device is in a menu mode.
- the display device 100 may perform a display device control operation based on the input signal.
- this input signal may indicate that it is a signal for controlling the display device in the menu mode. Accordingly, the display device 100 can convert the controller input signal into a display device control signal and perform an operation corresponding to the converted display device control signal.
- Figure 15 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the display device 100 may detect that the menu mode is ended. For example, when a screen for controlling a display device is terminated, such as when a user interface screen is terminated according to a user input, the display device 100 may detect that the menu mode is terminated. Additionally, the end of the menu mode may indicate the start of the content playback control mode.
- the display device 100 may transmit information indicating that the display device is in a content playback control mode to the server device 300.
- the server device 300 may store information received from the display device 100 indicating that the display device is in a content playback control mode.
- the server device 300 when the server device 300 stores information indicating that the display device 100 is in a content playback control mode and then receives an input signal from the controller 200, it can operate as shown in FIG. 13.
- Figure 16 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the controller 200 may transmit an input signal according to user manipulation to the server device 300. While the display device 100 displays content based on the results of application execution from the server device 300, the user may operate the controller 200 to control execution of content displayed on the display device 100. For example, in order to manipulate the forward movement of a specific character in the content displayed on the display device 100, the user may input a manipulation corresponding to the forward motion using a button, key, or dial provided on the controller 200, and the controller 200 accordingly allows the user to move forward. An input signal corresponding to the manipulation input may be transmitted to the server device 300.
- the server device 300 may determine whether the input signal represents a predetermined value.
- the server device 300 may receive and store an input signal list representing pre-designated values from the display device 100. If the input signal represents a pre-specified value, proceed to ⁇ B>, and if the input signal does not represent a pre-specified value, proceed to operation 1630.
- the server device 300 may execute the content application based on the input signal and transmit the execution result screen to the display device 100.
- the display device 100 may receive an application execution result screen from the server device 300 and display the received execution result screen.
- the execution result screen displayed on the display device 100 shows the forward motion of the specific character. It may include images that were performed.
- 17 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the server device 300 may transmit the input signal of the controller to the display device 100 as is.
- the controller input signal is transmitted as is to the display device 100 in order to allow the display device 100 to enter the menu mode.
- the display device 100 may output a user interface screen for controlling the display device as the input signal from the controller rotor indicates a predetermined value.
- the user interface screen may include a quick panel, etc.
- the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the display device.
- the display device 100 In order to directly receive an input signal for controlling the display device from the controller 200 while the display device 100 displays a user interface screen, that is, during the menu mode of the display device, the display device 100 sends a control command to the controller to transmit the input signal to the display device. You can send it to 200.
- Such control commands may be transmitted to the controller 200 through Bluetooth communication technology or Wi-Fi communication technology.
- the controller 200 may receive a control command to transmit an input signal to the display device and transmit the input signal according to the user input to the display device 100.
- the display device 100 may directly receive an input signal for controlling the user interface screen displayed on the display from the controller 200 instead of receiving it through the server device 300.
- the display device 100 may perform a control operation of the display device based on the input signal.
- Figure 18 is a flowchart of an example of a method of operating a controller, a server device, and a display device according to an embodiment.
- the display device 100 may detect that the menu mode is ended. For example, when a screen for controlling a display device is terminated, such as when a user interface screen is terminated according to a user input, the display device 100 may detect that the menu mode is terminated. Additionally, the end of the menu mode may indicate the start of the content playback control mode.
- the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the server device. That is, when the menu mode of the display device ends and the content playback control mode begins, the display device 100 causes the controller 200 to input an input screen in order to receive a result screen according to the playback control of the content displayed on the display of the display device from the server device 300. The signal is transmitted to the server device 300.
- the controller 200 may receive a control command from the display device 100 and then receive a user input.
- the controller 200 may transmit an input signal according to the user input to the server device 300.
- the server device 300 may determine whether the input signal received from the controller 200 represents a predetermined value. The following operations are the same as in 16, so further explanation is omitted.
- Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include computer storage media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.
- the disclosed embodiments may be implemented as S/W programs including instructions stored in computer-readable storage media.
- a computer is a device capable of calling instructions stored from a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include an electronic device according to the disclosed embodiments.
- Computer-readable storage media may be provided in the form of non-transitory storage media.
- ‘non-transitory’ only means that the storage medium does not contain signals and is tangible, and does not distinguish whether the data is stored semi-permanently or temporarily in the storage medium.
- control method according to the disclosed embodiments may be included and provided in a computer program product.
- Computer program products are commodities and can be traded between sellers and buyers.
- a computer program product may include a S/W program and a computer-readable storage medium in which the S/W program is stored.
- a computer program product may include a product in the form of a S/W program (e.g., a downloadable app) distributed electronically by the device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store).
- an electronic marketplace e.g., Google Play Store, App Store.
- at least part of the S/W program may be stored in a storage medium or temporarily created.
- the storage medium may be a manufacturer's server, an electronic market server, or a relay server's storage medium that temporarily stores the SW program.
- a computer program product in a system comprised of a server and a device, may include a storage medium of a server or a storage medium of a device.
- the computer program product may include a storage medium of the third device.
- the computer program product may include a S/W program itself that is transmitted from a server to a device or a third device, or from a third device to the device.
- one of the server, the device, and the third apparatus may execute the computer program product to perform the method according to the disclosed embodiments.
- two or more of a server, a device, and a third apparatus may execute the computer program product and perform the methods according to the disclosed embodiments in a distributed manner.
- a server eg, a cloud server or an artificial intelligence server, etc.
- a server may execute a computer program product stored on the server and control a device connected to the server to perform the method according to the disclosed embodiments.
- a third device may execute a computer program product to control a device communicatively connected to the third device to perform the method according to the disclosed embodiment.
- the third device may download the computer program product from the server and execute the downloaded computer program product.
- the third device may perform the methods according to the disclosed embodiments by executing the computer program product provided in a preloaded state.
- a “unit” may be a hardware component such as a processor or circuit, and/or a software component executed by the hardware component such as a processor.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Digital Computer Display Output (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims (15)
- 디스플레이 장치에 있어서,통신 인터페이스,하나 이상의 인스트럭션을 저장하는 메모리, 및상기 메모리에 저장된 상기 하나 이상의 인스트럭션을 실행하는 프로세서를 포함하고,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,서버 장치에 연결되어 입력 신호를 제공하는 콘트롤러로부터의 상기 입력 신호에 기반하여 컨텐츠 어플리케이션을 실행함으로써 얻어진 제1실행 결과 컨텐츠를 상기 통신 인터페이스를 통해서 상기 서버 장치로부터 수신하고,상기 제1실행 결과 컨텐츠를 표시하도록 상기 디스플레이를 제어하고,상기 콘트롤러에 의해 상기 서버 장치로 전달된, 미리 정해진 값을 나타내는 상기 콘트롤러로부터의 제1입력 신호를 상기 통신 인터페이스를 통해서 상기 서버 장치로부터 수신하고,상기 미리 정해진 값을 나타내는 제1입력 신호의 수신에 따라, 상기 디스플레이 장치를 제어하기 위한 사용자 인터페이스 화면을 표시하고,상기 사용자 인터페이스 화면을 표시하는 동안, 상기 콘트롤러로부터의 제2입력 신호를 수신하고, 상기 제2입력 신호에 기반하여 상기 디스플레이 장치의 동작을 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 사용자 인터페이스 화면을 표시하는 동안, 상기 콘트롤러로부터의 제2입력 신호를 상기 통신 인터페이스를 통해서 상기 서버 장치를 통해 전달받거나 또는 상기 콘트롤러로부터의 제2입력 신호를 상기 통신 인터페이스를 통해서 상기 콘트롤러로부터 직접 수신하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 사용자 인터페이스 화면을 표시하는 동안, 상기 사용자 인터페이스 화면의 표시를 종료하는 제2입력 신호에 따라 상기 사용자 인터페이스 화면의 표시를 종료하도록 상기 디스플레이를 제어하고,상기 사용자 인터페이스 화면의 표시의 종료에 따라 상기 디스플레이 장치가 컨텐츠 재생 제어 모드로 동작함을 나타내는 신호를 상기 서버 장치로 전송하도록 상기 통신 인터페이스를 제어하는, 디스플레이 장치.
- 제3항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 디스플레이 장치가 컨텐츠 재생 제어 모드로 동작함을 나타내는 신호의 전송에 따라, 상기 콘트롤러로부터 수신되는 제3입력 신호에 따라 상기 컨텐츠 어플리케이션을 실행함으로써 얻어지는 제2실행 결과 컨텐츠를 상기 서버 장치로부터 수신하도록 상기 통신 인터페이스를 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 컨텐츠 어플리케이션의 타입이 미리 정해진 타입인지를 식별하고,상기 컨텐츠 어플리케이션의 타입이 상기 미리 정해진 타입 임에 따라, 상기 미리 정해진 값을 나타내는 하나 이상의 입력 신호를 포함하는 리스트를 상기 서버 장치로 전송하도록 상기 통신 인터페이스를 제어하는, 디스플레이 장치.
- 제1항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 컨텐츠 어플리케이션의 타입이 미리 정해진 타입인지를 식별하고,상기 컨텐츠 어플리케이션의 타입이 상기 미리 정해진 타입 임에 따라, 상기 콘트롤러가 상기 서버 장치에 직접 연결할 수 있도록 하기 위한 정보 및 상기 서버 장치에 연결하도록 제어하는 명령을 상기 콘트롤러로 전송하는, 디스플레이 장치.
- 서버 장치에 있어서,통신 인터페이스,적어도 하나의 인스트럭션을 저장하는 메모리, 및상기 메모리에 저장된 상기 적어도 하나의 인스트럭션을 실행하는 프로세서 를 포함하고,상기 프로세서는 상기 하나 이상의 인스트럭션을 실행함으로써,컨텐츠 어플리케이션을 실행함으로써 얻어지는 제1 실행 결과 컨텐츠를 디스플레이 장치로 전송하도록 상기 통신 인터페이스를 제어하고,콘트롤러로부터의 제1 입력 신호를 수신하도록 상기 통신 인터페이스를 제어하고,상기 제1입력 신호가 미리 정해진 값을 나타내는 지 식별하고,상기 제1입력 신호가 상기 미리 정해진 값을 나타내는 것으로 식별됨에 따라, 상기 디스플레이 장치로 하여금 사용자 인터페이스 화면을 출력할 수 있도록 상기 입력 신호를 상기 디스플레이 장치로 전송하도록 상기 통신 인터페이스를 제어하고,상기 제1 입력 신호가 상기 미리 정해진 값을 나타내지 않는 것으로 식별됨에 따라, 상기 입력 신호에 따라 상기 컨텐츠 어플리케이션을 실행함으로써 얻어지는 제2실행 결과 컨텐츠를 상기 디스플레이 장치로 전송하도록 상기 통신 인터페이스를 제어하는, 서버 장치.
- 제7항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 디스플레이 장치가 상기 사용자 인터페이스 화면을 출력하는 메뉴 모드로 동작하는 동안, 상기 콘트롤러로부터 수신되는 제2입력 신호를 상기 디스플레이 장치로 전달하도록 상기 통신 인터페이스를 제어하는, 서버 장치.
- 제7항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 디스플레이 장치가 상기 메뉴 모드로 동작하는 동안, 상기 디스플레이 장치로부터 상기 디스플레이 장치가 컨텐츠 재생 제어 모드로 전환됨을 나타내는 신호를 수신하도록 상기 통신 인터페이스를 제어하고,상기 신호의 수신에 따라 상기 디스플레이 장치가 상기 컨텐츠 재생 제어 모드로 동작함을 인식하고,상기 인식에 따라, 상기 콘트롤러로부터 수신되는 입력 신호에 따라 상기 컨텐츠 어플리케이션을 실행함으로써 얻어지는 제3실행 결과 컨텐츠를 상기 디스플레이 장치로 전송하도록 상기 통신 인터페이스를 제어하는, 서버 장치.
- 제7항에 있어서,상기 프로세서는, 상기 적어도 하나의 인스트럭션을 실행함으로써,상기 미리 정해진 값을 나타내는 하나 이상의 입력 신호를 포함하는 리스트를 상기 디스플레이 장치로부터 수신하여 저장하는, 서버 장치.
- 디스플레이 장치의 동작 방법에 있어서,서버 장치에 연결되어 제1입력 신호를 제공하는 콘트롤러로부터의 상기 입력 신호에 기반하여 컨텐츠 어플리케이션을 실행함으로써 얻어진 제1실행 결과 컨텐츠를 상기 서버 장치로부터 수신하는 동작,상기 제1실행 결과 컨텐츠를 표시하는 동작,상기 콘트롤러에 의해 상기 서버 장치로 전달된, 미리 정해진 값을 나타내는 상기 콘트롤러로부터의 입력 신호를 상기 서버 장치로부터 수신하는 동작,상기 미리 정해진 값을 나타내는 제1입력 신호의 수신에 따라, 상기 디스플레이 장치를 제어하기 위한 사용자 인터페이스 화면을 표시하는 동작, 및상기 사용자 인터페이스 화면을 표시하는 동안, 상기 콘트롤러로부터의 제2입력 신호를 수신하고, 상기 제2입력 신호에 기반하여 상기 디스플레이 장치를 제어하는 동작을 포함하는, 디스플레이 장치의 동작 방법.
- 제11항에 있어서,상기 사용자 인터페이스 화면을 표시하는 동안, 상기 콘트롤러로부터의 제2 입력신호를 상기 통신 인터페이스를 통해서 상기 서버 장치를 통해 전달받거나 또는 상기 콘트롤러로부터의 제2 입력신호를 상기 통신 인터페이스를 통해서 상기 콘트롤러로부터 직접 수신하는 동작을 더 포함하는. 디스플레이 장치의 동작 방법.
- 제11항에 있어서,상기 사용자 인터페이스 화면을 표시하는 동안, 상기 사용자 인터페이스 화면의 표시를을 종료하는 제2입력 신호에 따라 상기 사용자 인터페이스 화면의 표시를 종료하는 동작, 및상기 사용자 인터페이스 화면의 종료에 따라 상기 디스플레이 장치가 컨텐츠 재생 제어 모드로 동작함을 나타내는 신호를 상기 서버 장치로 전송하는 동작을 더 포함하는, 디스플레이 장치의 제어 방법.
- 서버 장치의 동작 방법에 있어서,컨텐츠 어플리케이션을 실행함으로써 얻어지는 제1실행 결과 컨텐츠를 디스플레이 장치로 전송하는 동작,콘트롤러로부터의 제1입력 신호를 수신하는 동작,상기 제1입력 신호가 미리 정해진 값을 나타내는지 식별하는 동작,상기 제1입력 신호가 상기 미리 정해진 값을 나타내는 것으로 식별됨에 따라, 상기 디스플레이 장치로 하여금 사용자 인터페이스 화면을 출력할 수 있도록 상기 제1입력 신호를 상기 디스플레이 장치로 전송하는 동작, 및상기 제1입력 신호가 상기 미리 정해진 값을 나타내지 않는 것으로 식별됨에 따라, 상기 입력 신호에 따라 상기 컨텐츠 어플리케이션을 실행함으로써 얻어지는 제2실행 결과 컨텐츠를 상기 디스플레이 장치로 전송하는 동작을 포함하는, 서버 장치의 동작 방법.
- 디스플레이 장치의 동작 방법의 구현을 위해 디스플레이 장치의 프로세서에 의해 실행되는 하나 이상의 프로그램이 기록된 컴퓨터 판독가능 기록 매체에 있어서, 상기 디스플레이 장치의 동작 방법은,서버 장치에 연결되어 제1입력 신호를 제공하는 콘트롤러로부터의 상기 입력 신호에 기반하여 컨텐츠 어플리케이션을 실행함으로써 얻어진 제1실행 결과 컨텐츠를 상기 서버 장치로부터 수신하는 동작,상기 제1실행 결과 컨텐츠를 표시하는 동작,상기 콘트롤러에 의해 상기 서버 장치로 전달된, 미리 정해진 값을 나타내는 상기 콘트롤러로부터의 제2입력 신호를 상기 서버 장치로부터 수신하는 동작,상기 미리 정해진 값을 나타내는 제2입력 신호의 수신에 따라, 상기 디스플레이 장치를 제어하기 위한 사용자 인터페이스 화면을 표시하는 동작, 및상기 사용자 인터페이스 화면을 표시하는 동안, 상기 콘트롤러로부터의 제2입력 신호를 수신하고, 상기 제2입력 신호에 기반하여 상기 디스플레이 장치를 제어하는 동작을 포함하는, 컴퓨터 판독가능 기록 매체.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2025500166A JP2025528661A (ja) | 2022-06-28 | 2023-06-27 | ディスプレイ装置及びその動作方法 |
| EP23831877.8A EP4503622A4 (en) | 2022-06-28 | 2023-06-27 | SCREEN DEVICE AND ITS OPERATING METHOD |
| CN202380050097.4A CN119366193A (zh) | 2022-06-28 | 2023-06-27 | 显示装置及其操作方法 |
| US18/368,955 US12314619B2 (en) | 2022-06-28 | 2023-09-15 | Display apparatus and operating method of the display apparatus |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2022-0079239 | 2022-06-28 | ||
| KR20220079239 | 2022-06-28 | ||
| KR1020220168095A KR20240002132A (ko) | 2022-06-28 | 2022-12-05 | 디스플레이 장치 및 그 동작 방법 |
| KR10-2022-0168095 | 2022-12-05 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/368,955 Continuation US12314619B2 (en) | 2022-06-28 | 2023-09-15 | Display apparatus and operating method of the display apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024005518A1 true WO2024005518A1 (ko) | 2024-01-04 |
Family
ID=89381057
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2023/008976 Ceased WO2024005518A1 (ko) | 2022-06-28 | 2023-06-27 | 디스플레이 장치 및 그 동작 방법 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12314619B2 (ko) |
| EP (1) | EP4503622A4 (ko) |
| JP (1) | JP2025528661A (ko) |
| CN (1) | CN119366193A (ko) |
| WO (1) | WO2024005518A1 (ko) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN121444466A (zh) * | 2023-05-30 | 2026-01-30 | 三星电子株式会社 | 显示设备及其操作方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160110004A (ko) * | 2015-03-11 | 2016-09-21 | 엘지전자 주식회사 | 디스플레이 디바이스 및 그 제어 방법 |
| KR20200135866A (ko) * | 2018-04-02 | 2020-12-03 | 구글 엘엘씨 | 대화형 클라우드 게임용 방법, 디바이스 및 시스템 |
| KR20210112278A (ko) * | 2014-11-17 | 2021-09-14 | 삼성전자주식회사 | 음성 인식 시스템, 서버, 디스플레이 장치 및 그 제어 방법 |
| KR20210157142A (ko) * | 2020-06-19 | 2021-12-28 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| BRPI0718670A2 (pt) * | 2006-12-05 | 2013-11-26 | Thomson Licensing | Método, aparelho e sistema para controle e otimização de dispositivo de playout |
| KR20160134355A (ko) | 2015-05-15 | 2016-11-23 | 삼성전자주식회사 | 디스플레이 장치 및 이의 제어 방법 |
| KR102160166B1 (ko) | 2016-09-02 | 2020-09-25 | 베이징 시아오미 모바일 소프트웨어 컴퍼니 리미티드 | 기기 제어 방법, 장치, 프로그램 및 저장매체 |
| US10773156B2 (en) * | 2018-11-05 | 2020-09-15 | Sony Interactive Entertainment LLC | Systems and methods for establishing direct communication between a server system and a video game controller |
| KR102673735B1 (ko) * | 2019-01-08 | 2024-06-10 | 삼성전자주식회사 | 영상 표시 장치 및 그 동작방법 |
| KR20210028376A (ko) | 2019-09-04 | 2021-03-12 | 주식회사 볼트홀 | 클라우드 게임 서비스 제공 방법, 장치 및 이를 이용한 시스템 |
| KR102790303B1 (ko) | 2020-03-12 | 2025-04-04 | 구글 엘엘씨 | 클라우드 게임의 플레이어 인터렉티브 윈도우를 위한 레이턴시-인식 플레이어 입력 필터링 |
| CN113398581B (zh) | 2021-06-30 | 2023-09-19 | 广州方硅信息技术有限公司 | 游戏画面显示方法、装置、电子设备及可读存储介质 |
| CN117651931A (zh) | 2021-08-12 | 2024-03-05 | 三星电子株式会社 | 显示设备及其操作方法 |
| KR20230024778A (ko) | 2021-08-12 | 2023-02-21 | 삼성전자주식회사 | 디스플레이 장치 및 그 동작 방법 |
-
2023
- 2023-06-27 WO PCT/KR2023/008976 patent/WO2024005518A1/ko not_active Ceased
- 2023-06-27 EP EP23831877.8A patent/EP4503622A4/en active Pending
- 2023-06-27 JP JP2025500166A patent/JP2025528661A/ja active Pending
- 2023-06-27 CN CN202380050097.4A patent/CN119366193A/zh active Pending
- 2023-09-15 US US18/368,955 patent/US12314619B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20210112278A (ko) * | 2014-11-17 | 2021-09-14 | 삼성전자주식회사 | 음성 인식 시스템, 서버, 디스플레이 장치 및 그 제어 방법 |
| KR20160110004A (ko) * | 2015-03-11 | 2016-09-21 | 엘지전자 주식회사 | 디스플레이 디바이스 및 그 제어 방법 |
| KR20200135866A (ko) * | 2018-04-02 | 2020-12-03 | 구글 엘엘씨 | 대화형 클라우드 게임용 방법, 디바이스 및 시스템 |
| KR20210157142A (ko) * | 2020-06-19 | 2021-12-28 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
Non-Patent Citations (2)
| Title |
|---|
| ANONYMOUS: "2022 TV Gaming Hub Usage Guide", SAMSUNG - SOLVE IT YOURSELF - TVLARGE - LCD/LED/QLED TV, SAMSUNG ELECTRONICS SERVICE CO., LTD, KOREA, Korea, XP009552082, Retrieved from the Internet <URL:https://www.samsungsvc.co.kr/solution/1010881> * |
| See also references of EP4503622A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4503622A4 (en) | 2025-08-20 |
| EP4503622A1 (en) | 2025-02-05 |
| JP2025528661A (ja) | 2025-09-02 |
| US20240004600A1 (en) | 2024-01-04 |
| US12314619B2 (en) | 2025-05-27 |
| CN119366193A (zh) | 2025-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017159941A1 (en) | Display device and method of operating the same | |
| WO2021137629A1 (en) | Display device, mobile device, video calling method performed by the display device, and video calling method performed by the mobile device | |
| WO2016137167A1 (en) | Terminal | |
| WO2018062715A1 (en) | Apparatus and control method for displaying content of peripheral device | |
| WO2021162320A1 (en) | Electronic device and method for operating high speed screen of electronic device | |
| WO2019182323A1 (ko) | 영상 표시 장치 및 그 동작 방법 | |
| WO2021117953A1 (ko) | 디스플레이 장치 | |
| WO2021060590A1 (ko) | 디스플레이 장치 및 인공 지능 시스템 | |
| WO2016013705A1 (ko) | 원격제어장치 및 그의 동작 방법 | |
| WO2020045858A1 (en) | Electronic apparatus and method of controlling the same | |
| WO2021070976A1 (ko) | 소스 기기 및 무선 시스템 | |
| WO2019125036A1 (en) | Image processing method and display apparatus therefor | |
| WO2019091128A1 (zh) | 新接入信源的信号预览方法及电视机 | |
| WO2024005518A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
| WO2022075741A1 (ko) | 전자 장치 및 그 동작 방법 | |
| WO2020171245A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
| WO2022119248A1 (ko) | 제어 장치 및 그 동작 방법 | |
| WO2025070971A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
| WO2022234874A1 (ko) | 무선 디스플레이 시스템 | |
| WO2022149620A1 (ko) | 디스플레이 장치 | |
| WO2025206715A1 (ko) | 전자 장치 및 그 동작 방법 | |
| WO2024005543A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
| WO2026084551A1 (ko) | 전자 장치 및 그 동작 방법 | |
| WO2024196095A1 (ko) | 디스플레이 장치 및 그 동작 방법 | |
| WO2025216481A1 (ko) | 전자 장치 및 그 동작 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23831877 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023831877 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2023831877 Country of ref document: EP Effective date: 20241101 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380050097.4 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2025500166 Country of ref document: JP |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380050097.4 Country of ref document: CN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |