WO2012169780A2 - Appareil de contrôle, appareil de contrôle cible et procédé pour convertir un contenu au moyen de ce dernier - Google Patents

Appareil de contrôle, appareil de contrôle cible et procédé pour convertir un contenu au moyen de ce dernier Download PDF

Info

Publication number
WO2012169780A2
WO2012169780A2 PCT/KR2012/004467 KR2012004467W WO2012169780A2 WO 2012169780 A2 WO2012169780 A2 WO 2012169780A2 KR 2012004467 W KR2012004467 W KR 2012004467W WO 2012169780 A2 WO2012169780 A2 WO 2012169780A2
Authority
WO
WIPO (PCT)
Prior art keywords
conversion
content
information
virtual
converted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2012/004467
Other languages
English (en)
Korean (ko)
Other versions
WO2012169780A3 (fr
Inventor
양승률
전범진
박장웅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of WO2012169780A2 publication Critical patent/WO2012169780A2/fr
Publication of WO2012169780A3 publication Critical patent/WO2012169780A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/06—Message adaptation to terminal or network requirements
    • H04L51/063—Content adaptation, e.g. replacement of unsuitable content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/24—Negotiation of communication capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Definitions

  • the present invention relates to a control device, a control target device and a content conversion method, and more particularly, to a method of operating a control device and a control target device for providing a content conversion service and a reproduction service accordingly.
  • Universal plug and play (UPnP) technology and digital living network alliance (DLNA) technology enable service and control between consumer electronics devices from a variety of manufacturers.
  • UPnP technology and DLNA technology enable compatible AV services and controls between audio-visual (AV) devices. These compatible AV services include media streaming, uploading and downloading.
  • UPnP is a home network device that is a digital media server (DMS), digital media player (DMP), digital media renderer (DMR), digital media controller (DMC) and It defines digital media printer (DMPr), mobile digital media server (M-DMS), mobile digital media player (M-DMP), mobile digital A media uploader (M-DMU), a mobile digital media downloader (M-DMD), and a mobile digital media controller (M-DMC) are defined.
  • DMS digital media server
  • DMR digital media renderer
  • DMC digital media controller
  • DMPr digital media printer
  • M-DMS mobile digital media server
  • M-DMP mobile digital media player
  • M-DMU mobile digital A media uploader
  • M-DMD mobile digital media downloader
  • M-DMC mobile digital media controller
  • the digital media server (DMS) is used to cover the M-DMS
  • the digital media player (DMP) is used to cover the M-DMP
  • the digital media controller (DMC) covers the M-DMC. Use it as a concept.
  • Such devices may be classified into control point (CP) devices and control target devices.
  • the digital media controller (DMC) and the digital media player (DMP) may be classified as control point devices, and the digital media renderer (DMR), digital media server (DMS), and DMPr may be classified as control target devices.
  • DMC digital media controller
  • DMP digital media player
  • DMR digital media renderer
  • DMS digital media server
  • DMPr may be classified as control target devices.
  • DLNA defines a 2 Box Model and a 3 Box Model.
  • the two box model includes a digital media player (DMP) and a digital media server (DMS).
  • DMP digital media player
  • DMS digital media server
  • the three box model includes a digital media controller (DMC), a digital media server (DMS), and a digital media renderer (DMR).
  • DMC digital media controller
  • DMS digital media server
  • DMR digital media renderer
  • IP Networking Internet protocol networking
  • Such an AV service may include a streaming service for streaming AV content from a digital media server to a digital media renderer.
  • the digital media renderer can play the streamed AV content.
  • the control point controls the digital media server and the digital media renderer such that the user can play the specific AV content of the desired digital media server on the specific digital media renderer.
  • An object of the present invention is to provide a control device, a control target device and a method of operating the same, when the content to be streamed cannot be reproduced by the control target device, which can be converted and streamed to be playable.
  • Another object of the present invention is to provide a control device, a control target device, and a method of operating the same, which efficiently convert and store content and stream content using network resources.
  • Another object of the present invention is to provide a control device, a control target device, and an operation method thereof, which can be converted in advance even when there is no user request.
  • a method of operating a control device includes a method of providing a content conversion service by a control device using a control target device, the method comprising: searching for control target devices connected to a home network; Selecting one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses; Determining whether the renderer can play the selected content based on protocol information received from at least one renderer of the discovered devices and the content information; And if it cannot be reproduced, requesting one of the discovered devices to start conversion for the selected content.
  • a method of operating a control target device comprising: transmitting at least one of content information and stored information to the virtual server device according to a request of the virtual server device; ; Transmitting conversion capability information to the virtual conversion device according to a request of the virtual conversion device; Receiving a conversion start request message from the virtual conversion device; And converting a profile of specific content on a network based on the conversion start request message.
  • a control device includes: a communication module for searching for control target devices connected to a home network, and performing communication with the found control target devices; And selecting one of contents included in the server apparatus based on content information received from at least one server apparatus among the discovered apparatuses, and a protocol received from a renderer to play the content among the discovered apparatuses.
  • the control target device transmits at least one of content information and storage information to the virtual server device according to a request of the virtual server device, and transmits the conversion capability information according to the request of the virtual conversion device.
  • a communication module for transmitting to the conversion device;
  • a control unit for converting a profile of a specific content on a network based on the conversion start request message when receiving a conversion start request message from the virtual conversion device through the communication module, wherein the control unit is a playback device connected to the network. Stream the converted content through the communication module in response to a streaming request from.
  • control device and the control target device can convert and stream the content that cannot be converted in the playback device.
  • control device and the control target device can reduce the load of network resources by efficiently utilizing network resources during conversion.
  • the server device may perform the conversion in advance to improve user convenience.
  • FIG. 1 is a diagram schematically illustrating a home network including a control device and a control target device according to an exemplary embodiment of the present invention.
  • FIG. 2 is a ladder diagram illustrating a content conversion method according to an embodiment of the present invention.
  • FIG. 3 is a ladder diagram for describing a content conversion method according to another embodiment of the present invention.
  • FIG. 4 is a ladder diagram for explaining a process of collecting transformation capability information by a virtual transformation apparatus according to an exemplary embodiment of the present invention.
  • FIG. 5 is a ladder diagram for explaining a process of collecting storage information by a virtual storage device according to an exemplary embodiment of the present invention.
  • FIG. 6 is a ladder diagram for explaining a process of collecting playback capability information by a virtual playback apparatus according to an exemplary embodiment of the present invention.
  • FIG. 7 is a ladder diagram for explaining a process of converting content without storage by a control device and a control target device according to another embodiment of the present invention.
  • FIG. 8 is a ladder diagram for describing a method of converting content between a control device and a control target device when alternative storage is selected according to another embodiment of the present invention.
  • 9 to 14 are ladder diagrams for describing various examples of content conversion methods of a control device and a control target device when storage is selected according to another embodiment of the present invention.
  • 15 to 18 are ladder diagrams for describing content conversion methods of a control device and a control target device which perform conversion in advance according to another embodiment of the present invention.
  • 19 is a flowchart illustrating a method of operating a virtual conversion apparatus according to an embodiment of the present invention.
  • 20 to 25 are diagrams illustrating a user interface output according to a content conversion method according to an embodiment of the present invention.
  • FIG. 26 is a block diagram illustrating a configuration of a control device or a control target device according to an embodiment of the present invention.
  • components expressed as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements or firmware / microcode, etc. that perform the functions. It is intended to include all methods of performing a function which are combined with appropriate circuitry for executing the software to perform the function.
  • the invention, as defined by these claims, is equivalent to what is understood from this specification, as any means capable of providing such functionality, as the functionality provided by the various enumerated means are combined, and in any manner required by the claims. It should be understood that.
  • FIG. 1 is a diagram illustrating a network including a control device and a control target device according to an exemplary embodiment of the present invention.
  • the control device 100 and the control target devices 200 and 300 access a network to exchange information for content conversion.
  • the network may be a home network according to UPnP or DLNA.
  • control device 100 connected to the network may include a control point
  • control target device may include a control target device 200 including a media server, and a control target device 300 including a media renderer. It can be divided into.
  • the media server stores and manages the content, and provides a function of converting the content, transmitting or streaming the content according to the request of the control device 100.
  • the media renderer provides a function of receiving and playing back the converted content from the network.
  • control target device 200 including a media server may mean a device that can be stored, such as a computer, a network access server (NAS), a phone, and the control target device 300 including a media renderer is a BD / DVD. It may mean devices capable of playing received content such as a player, a set top box, a TV, and the like.
  • NAS network access server
  • the control target device 300 including a media renderer is a BD / DVD. It may mean devices capable of playing received content such as a player, a set top box, a TV, and the like.
  • control target device including the media server may be referred to simply as a media server or a digital media server (DMS) as described above, and the control target device including the media renderer may be a media renderer or the above.
  • DMR digital media renderer
  • control device 100 includes a control point, and the control point provides the AV service to the user by controlling the function of converting, storing, transmitting, streaming, and playing the content of the media server 200 and the media renderer 300. It performs the function.
  • control device 100 that provides the AV service using the control point may be referred to as a digital media controller (DMC) or simply the control point device 100.
  • DMC digital media controller
  • FIG. 2 is a ladder diagram illustrating a content conversion method according to an embodiment of the present invention.
  • control point apparatus 100 requests content information from the media server 200 (S1000).
  • the control point apparatus 100 may request content information by transmitting a content information request message to the media server 200.
  • the content information request message may include a content list request message included in the media server 200.
  • the content information request message may include a browse action (Browse ()) or search action (Search ()) message for a content directory service (CDS) provided by the media server 200.
  • the content information request message including a browse action (Browse ()) or search action (Search ()) may include, for example, request information of content objects included in the media server 200, and the content objects are assigned to each content.
  • the metadata may include corresponding metadata, and may include content profile information corresponding to each content.
  • the content profile information may include at least one of the format, bitrate, scale, and rotation information of the content.
  • the media server 200 transmits content information to the control point apparatus 100 (S1005).
  • the media server 200 may provide a content directory service as described above.
  • the media server 200 may generate content information about the contents stored in the media server 200 and transmit the content information to the control point device 100 using the content directory service.
  • the content information may include content objects, and the content objects may include content profile information corresponding to each content.
  • the control point device 100 receives a user selection input for the received content information (S1010).
  • the control point device 100 may display a list of contents included in the media server 200 on the user interface based on the received content information.
  • the control point apparatus 100 may receive a user selection input for the displayed user interface. The user may select content to be played back from the displayed content list.
  • control point device 100 may perform a playback operation on the content to be selected.
  • the user interface may receive a user input in various ways such as touch input, key input, soft key input, gesture, motion sensing, and the like, and a detailed operation method will be described later.
  • the control point device 100 requests protocol information from the media renderer 300 (S1010).
  • control point device 100 may request protocol information from the media renderer 300 to determine whether the media renderer 300 is playable. In addition, the control point apparatus 100 may request and store the protocol information from the media renderer 300 even before a user selection input.
  • the control point apparatus 100 may request protocol information from the media renderer 300 by transmitting a protocol information request message.
  • the protocol information request message may include a protocol information action GetProtocolInfo () for a connection manager service provided by the media renderer 300.
  • the protocol information may include transmission protocol information that can be received by the media renderer 300 and data format information that can be reproduced by the media renderer 300.
  • the transmission protocol may include IEEE 1394, HTTP GET, RTSP / RTP, and the like
  • the data format information may include MPEG2, MPEG4, MP3, WMA, JPEG, and the like. Therefore, the control point apparatus 100 may determine a transmission protocol and a playable data format that the media renderer 300 can receive using the protocol information.
  • the media renderer 300 When the media renderer 300 receives the protocol information request message, the media renderer 300 generates the protocol information and transmits the protocol information to the control point apparatus 100 (S1020). As described above, the media renderer 300 may generate protocol information of the media renderer 300 according to the protocol information request action provided by the connection management service, and transmit the protocol information to the control point device 100.
  • control point apparatus 100 performs capability matching.
  • the control point apparatus 100 may perform capability matching by comparing and determining the profile information of the content selected in step S1010 and the protocol information of the media renderer 300.
  • the capability matching may mean an operation of determining whether the media renderer 300 can play the specific content selected in operation S1010.
  • control point apparatus 100 may extract a playable data format or a transmission protocol from protocol information received by the media renderer 300, and determine whether to play a specific content based on this.
  • control point apparatus 100 plays back the media renderer 300 when the data format or transmission protocol included in the protocol information matches the data format or transmission protocol included in the profile information corresponding to the selected specific content. It can be judged as possible.
  • the control point apparatus 100 may determine that the protocol information does not match. In addition, the control point apparatus 100 may determine that the capability is matched when the protocol information received from the media renderer 300 includes MPEG2, MPEG4, WMV, and MPEG4 is specified in the profile information of the user selected content. have.
  • control point apparatus 100 determines whether matching fails (S1030). If the matching is successful, the selected content can be played in the media renderer 300 without any problem, so that the control point device 100 performs a streaming operation of the media renderer 300 and a playback operation of the media renderer 300 in the media server 200. To control (S1035).
  • control point device 100 requests the media server 200 for the conversion information (S1040).
  • the control point device 100 may request the conversion information by transmitting the conversion information request message to the media server 200.
  • the transformation information request message may include a transformation permission request action (GetAllowedTransforms ()) for the content directory service provided by the media server 200.
  • the GetAllowedTransforms () action may be expressed as a message in XML format that requests transformation information for performing the transformation function when the content directory service includes the transformation function.
  • the transformation information may include, for example, transformation capability information.
  • the conversion capability information may include information on a data format, bitrate, scale, and rotation, which can be converted by the media server 200.
  • the conversion capability information may include output profiles for each input profile.
  • the conversion capability information may include MPEG2, MPEG4, etc. as an input profile, and may include WMV as an output profile.
  • the media server 200 transmits the conversion information to the control point apparatus 100 (S1045).
  • the media server 200 may transmit the conversion information to the control point device 100 in response to the conversion information request.
  • the conversion information may include data format or profile information that the media server 200 can convert.
  • control point device 100 When the control point device 100 receives the conversion information, the control point device 100 sets a conversion process (S1040).
  • the control point apparatus 100 may determine a data format to be converted based on the profile information of the content that fails to match, the protocol information and the conversion information of the media renderer 300, and set the conversion process accordingly.
  • the conversion process may, for example, indicate information about which content to convert from which format to which format.
  • the control point apparatus 100 may determine optimal data formats that can be played in the media renderer 300 from protocol information.
  • the control point apparatus 100 may determine which format the data format of the selected content can be converted in the media server 200 based on the conversion information. Accordingly, the control point apparatus 100 may determine a data format that can be converted in the media server 200 and can be smoothly reproduced in the media renderer 300, and thus, may determine a conversion process.
  • control point device 100 requests the media server 200 to start the conversion (S1045).
  • the control point apparatus 100 may request a conversion start by generating a conversion start request message based on the determined conversion process and transmitting the message to the media server 200.
  • the transformation start request message may include a transformation start action (StartTransform ()) command for the directory service of the media server 200.
  • the conversion start request message may include conversion process information.
  • the conversion process information may include at least one of identification information of the content to be converted, input profile information of the content to be converted, profile information of the content to be output after conversion, and identification information of the content to be output after conversion.
  • the control point apparatus 100 may designate the selected content as the content to be converted, generate the conversion start request message by specifying the content to be output by the conversion process, and transmit it to the media server 200.
  • the media server 200 When the media server 200 receives the conversion start request, the media server 200 transmits the conversion start response to the control point device 100 (S1050).
  • the media server 200 may receive a conversion start request message and obtain conversion process information based on the conversion start request message.
  • the conversion process information may include identification information of the content to be converted, input profile information, output profile information, and identification information of the content to be output, as described above.
  • the media server 200 may start the conversion based on the obtained conversion process information, and transmit the conversion start response to the control point device 100.
  • the conversion start response may indicate whether the conversion process information has been successfully received and conversion has started normally.
  • control point apparatus 100 Upon receiving the conversion start response, the control point apparatus 100 requests the media server 200 for the conversion progress state (S1055).
  • the control point apparatus 100 may transmit a conversion progress information request message indicating how much the current conversion is performed to the media server 200.
  • the transformation progress information request message may include a transformation progress request action (GetTransformProgress ()) command for the content directory service of the media server 200 described above.
  • the conversion progress information may indicate not only how much the current conversion is performed, but may also include identification information and profile information of the input content and identification information and profile information of the content to be output.
  • control point apparatus 100 may receive the conversion progress status information (S1060), and determine the progress status of the conversion process currently in progress in the media server 200.
  • control point apparatus 100 may output the current conversion state to the user based on the determined conversion progress state information.
  • the control point device 100 may indicate the conversion progress state to the user by using an audio or video, and may output profile information about the content to be converted and the content to be output after the conversion.
  • control point apparatus 100 may display that the conversion is in progress because the content corresponding to the current user selection input cannot be played in the media renderer 300.
  • control point apparatus 100 may allow the user to recognize the process by displaying the progress of the conversion, the format of the content to be converted, and the format of the content output after the conversion. .
  • the control point device 100 may perform the conversion in the background without outputting the conversion progress state for users who are not familiar with the device.
  • the media server 200 determines whether the conversion is completed (S1063). When the conversion is completed, the media server 200 transmits the conversion result to the control point apparatus 100 (S1065).
  • the media server 200 may generate a conversion result message and transmit it to the control point device 100.
  • the conversion result message may include XML data, and the conversion result message may be transmitted to all the control point devices 100 or the control target devices connected to the network by using an event method.
  • the conversion result message may include identification information of the converted content and profile information of the converted content.
  • control point device 100 When the control point device 100 receives the conversion result message, the control point device 100 requests a connection preparation to the media server 200 (S1070), and receives a response to the connection preparation request from the media server 200 (S1075).
  • the control point apparatus 100 may prepare a connection between the media server 200 and the media renderer 300 by transmitting a connection preparation request message and receiving a response thereto.
  • connection preparation request message may include, for example, a connection preparation action (PrepareForConnection ()) command for the connection management service.
  • the connection preparation request message may include setting information for AV transmission or streaming service of an AV service to be started later. Accordingly, the connection preparation request message may include at least one of identification information, data format information, and transmission protocol information of content to be transmitted from the media server 200 to the media renderer 300.
  • control point apparatus 100 may include the identification information and data format information of the converted content and the transmission protocol information from the media server 200 to the media renderer 300 in the connection preparation request message.
  • the media server 200 may perform connection preparation based on the received connection preparation request message, and generate a connection preparation response message and transmit the generated connection preparation response message to the control point device 100 according to success.
  • the media server 200 may load, for example, a previously converted content into a memory and set a protocol for transmission, for an AV service to be performed later.
  • control point apparatus 100 requests the media renderer 300 to prepare for connection (S1080), and receives a response to the connection preparation request from the media renderer 300 (S1085).
  • connection preparation request message may include a connection preparation action (PrepareForConnection ()) command for the connection management service, as described above.
  • the connection preparation request message may include setting information for an AV streaming service to be started later. Accordingly, the connection preparation request message may include at least one of identification information, data format information, and transmission protocol information of content to be transmitted from the media server 200 to the media renderer 300 described above.
  • the media renderer 300 may generate a connection preparation response message including information on whether the connection preparation is successful and transmit it to the control point device 100.
  • control point apparatus 100 transmits a transmission URI setting message to the media renderer 300 (S1090), and receives a response message from the media renderer 300 (S1095).
  • the transmission URI setting message may include URI information for allowing the media renderer 300 to receive specific AV data from the media server 200.
  • the transport URI setting message may include, for example, an AV transport URI setting action (SetAVTransportURI ()) command defined in the UPnP AV service.
  • the media renderer 300 obtains a URI capable of receiving AV data transmitted from the media renderer 300 based on the transmission URI setting message, and connects to the media server 200 based on the obtained URI, thereby providing the AV data. You are ready to receive it.
  • the media renderer 300 transmits a transmission URI response message including information on whether the setting is performed to the control point device 100.
  • control point apparatus 100 transmits a playback command to the media renderer 300 (S1100), and receives a response to the playback command from the media renderer 300 (S1105).
  • the play command may include a play action (Play ()) command of an AV service defined in UPnP.
  • the play command may include operation information for playing the specific content in the media renderer 300.
  • the playback command may include, for example, identification information and playback speed information of content to be played back.
  • the playback command may include identification information of the converted content as described above. Accordingly, the media renderer 300 may receive and play the converted content based on the received playback command. For example, the media renderer 300 may access the path where the converted content is located in the media server 200 using the above-described transmission URI.
  • the media server 200 streams the converted content to the media server 200 (S1115).
  • the media renderer 300 accesses the path where the converted content is located by using the transmission URI, the media server 200 may stream the converted content to the media server 200.
  • the media renderer 300 may play the converted content in real time.
  • the media renderer 300 may receive a streaming service of the converted content and play back a file such as an image, a sound, or an animation in real time without separately storing the file in a storage space of the receiving device.
  • the media renderer 300 or the media server 200 may store the converted content in a specific storage space according to a user selection input to the control point device 100, or may store the converted content in advance. This will be described later.
  • FIG. 3 is a ladder diagram for describing a content conversion method according to another embodiment of the present invention.
  • the control point apparatus 100 requests content information from the media server 200 (S1200), and the media server 200 responds to the content included in the media server 200 in response thereto.
  • the content information is transmitted to the control point device 100 (S1205).
  • the content information may include a content object corresponding to each content included in the media server 200.
  • the content object may include metadata about each content and may include profile information corresponding to each content.
  • the profile information may include at least one of a data format, bitrate, scale, and rotation information corresponding to each content.
  • the control point apparatus 100 receives a user selection input in operation S1210. As described above, the control point device 100 may receive a user selection input through a user interface. The control point device 100 may select any one of contents included in the media server 200 according to a user selection input.
  • the control point apparatus 100 requests protocol information from the media renderer 300 (S1215).
  • the media renderer 300 transmits protocol information of the media renderer 300 to the control point device 100 in response to the request.
  • the protocol information may include information about a transport protocol and a playable data format that can be received by the media renderer 300.
  • the control point apparatus 100 performs capability matching (S1225).
  • the capability matching may mean that the control point apparatus 100 determines whether profile information corresponding to the selected content matches protocol information of the media renderer 300.
  • the control point apparatus 100 extracts profile information of the selected content from the content information received from the media server 200, and matches data format information included in the extracted profile information to protocol information received from the media renderer 300. It can be determined whether or not to perform the ability matching.
  • the control point apparatus 100 may determine whether the data format of the selected content is playable in the media renderer 300.
  • control point apparatus 100 determines whether the matching is successful (S1230), and when the matching fails, the control point apparatus 100 performs a subsequent process from step S1040 to convert.
  • the control point apparatus 100 relays a file streaming process of the selected content between the media server 200 and the media renderer 300 (S1235).
  • the control point device 100 transmits a request to prepare the connection between the media server 200 and the media renderer 300, receives the response, and transmits the response to the media renderer 300.
  • the method may include transmitting a play command and receiving the selected content from the media server 200 by accessing the media renderer 300 according to the play command.
  • the media renderer 300 may provide a service of playing selected content according to a user selection input.
  • the transmission width of the data can be narrowed or the transmission rate can be lowered. Accordingly, file streaming may be interrupted. Therefore, in order to play smoothly when streaming files, it is necessary to convert the bit rate or the codec of the content according to the change of the network environment and transmit the data without interruption even at a low data rate.
  • control point apparatus 100 determines whether conversion is necessary (S1237).
  • the control point apparatus 100 may determine whether the conversion is necessary by detecting a change in the network environment. In addition, the control point device 100 may determine whether the conversion is necessary according to whether the currently detected network environment is lower or higher than a preset condition. In addition, the control point apparatus 100 may determine whether to convert according to a user input.
  • the user may input a conversion command through a user interface.
  • control point device 100 may detect whether the control point device 100 cuts off the screen and inquire the user of the conversion, and determine whether the conversion is necessary according to a user input for the query.
  • the control point device 100 requests the conversion information to the media server 200 (S1240), and receives the conversion information in response (S1245).
  • the conversion information may include conversion capability information of the media server 200 as described above, and the conversion capability information may include information on a data format, bitrate, scale, and rotation that are convertible in the media server 200. Can be.
  • the conversion capability information may include output profiles for each input profile.
  • the control point apparatus 100 sets a conversion process based on the conversion information (S1250).
  • the control point apparatus 100 may set the conversion process according to the change of the network environment. For example, when the network environment is degraded, the control point device 100 may set a content conversion process for converting content that is currently streamed to low quality. In addition, when the network environment is degraded, the control point device 100 may set a conversion process for converting the currently streamed content into a data format resistant to network environment changes.
  • the conversion process setting process is as described above.
  • the control point apparatus 100 transmits a conversion start request to the media server 200 (S1255), and receives a response thereto (S1260).
  • the conversion start request message may include information about the conversion process, as described above.
  • the media server 200 performs the conversion in accordance with the conversion start request (S1265).
  • the media server 200 changes the transmission URI to correspond to the converted content (S1270).
  • the media server 200 may change the transmission URI to correspond to the converted content instead of the existing streamed content, and set the converted file to be streamed. Accordingly, the media renderer 300 can play the converted content without changing the transmission setting.
  • the media server 200 streams the converted content file to the media renderer 300 (S1275).
  • the control point apparatus 100 controls content conversion of the media server 200 according to a change in network environment, thereby enabling seamless streaming content playback in the media renderer 300.
  • the media server 200 is unable to convert the content into a profile that can be played by the media renderer 300, there is a problem that can not be converted and streamed.
  • a virtual transformer may collect conversion capability information of devices connected in a network and provide a conversion service using devices connected to the network.
  • a translation service using network resources may be referred to as a virtual translation service.
  • the present invention proposes a virtual conversion device, a virtual storage device and a virtual playback device to provide a virtual conversion service.
  • FIG. 4 is a ladder diagram for explaining a process of collecting transformation capability information by a virtual transformation apparatus according to an exemplary embodiment of the present invention.
  • the virtual conversion apparatus 400 first requests device information from all devices connected to a network (S2000).
  • the virtual conversion apparatus 400 may convert specific content into another format by using devices connected to a network. To this end, the virtual conversion device 400 needs to collect information of each device connected to the network.
  • the virtual conversion device may be a separate conversion device physically separated, but may also refer to a control point device, a media server, or a media renderer that provides a virtual conversion service on a network.
  • the virtual transformation apparatus may refer to a group of a plurality of devices that provide a virtual transformation function.
  • the virtual conversion apparatus may include an MSCP (Medium Server Control Point) on UPnP protocol for controlling the media server, and may include an MRn (UPnP Media Renderer Control Point) on UPnP protocol for controlling the media renderer. .
  • the virtual conversion apparatus 400 may request device information from the first to N th devices connected to the network and perform device discovery.
  • the device information may indicate identification information, IP address or port information of each of the first to Nth devices located on the network. Therefore, the virtual conversion apparatus 400 may multicast the device information request message to all devices connected to the network, and receive the response to collect identification information, IP address, or port information about the devices connected to the network. have.
  • the virtual conversion apparatus 400 may multicast the discovery message using the Simple Service Discovery Protocol (SSDP) to identify other devices operating on the network.
  • SSDP Simple Service Discovery Protocol
  • the virtual conversion device 400 receives a response to the device information request (S2015).
  • Devices on the network that receive the device information request message transmitted from the virtual conversion device 400 may unicast a response message to the virtual conversion device 400 in response to the received device information request message. Through this, the virtual conversion device 400 may discover devices connected to the network, and list and manage identification information of each device for later conversion. Processes S2000 to S2015 may be referred to as device discovery processes.
  • the virtual conversion device 400 requests conversion capability information from the listed devices (S2035, S2040, and S2045).
  • the virtual conversion device 400 may request information about conversion capabilities that can be converted by each device connected to the network.
  • the virtual conversion apparatus 400 receives the conversion capability information in response to the request for the conversion capability information from each device (S2050, S2055, and S2060).
  • the virtual conversion apparatus 400 may generate a conversion capability information request message and multicast to the devices connected to the network.
  • the conversion capability information request message may include, for example, an action instruction requesting convertible output data formats for a particular data format.
  • the virtual transformation apparatus 400 may designate an input variable of an action command included in the transformation capability information request message in a specific input file format and transmit the input variable to a device connected to a network.
  • the virtual conversion apparatus 400 may specify metadata for all file formats as input variables and transmit them to each device without specifying an input file format.
  • the virtual conversion apparatus 400 may collect only conversion capability information for converting a specific input file format, and may reduce the amount of data required for transmission and reception.
  • the virtual conversion apparatus 400 may receive the conversion capability information in response to the conversion capability information request, and collect outputable file format information corresponding to a specific input file format or all file formats.
  • the conversion capability information may include, for example, input profile information and output profile information.
  • Each profile information may include at least one of data format, bitrate, scale, and rotation information.
  • the conversion capability information may include conversion capability information.
  • the conversion performance information may include, for example, time information required to perform a conversion in each device. Such time information may indicate the time required to convert content having an arbitrary file size and profile into a specific output profile.
  • the virtual transformation apparatus 400 may collect such transformation capability information and store the transformation capability information in correspondence with the above-described apparatus information. For example, the virtual conversion apparatus 400 may generate a mapping table that maps all convertible output file formats corresponding to the input file format and store the mapping table. In addition, the virtual conversion apparatus 400 may store devices that can be converted into a specific output file in a mapping table corresponding to the specific input file.
  • the virtual transformation apparatus 400 may determine the transformation capability and the transformation capability of each device connected to the network based on the collected transformation capability information when performing the transformation later.
  • the virtual conversion apparatus 400 may classify and store the conversion capability information for each device, and transfer the conversion capability information stored for each device according to a request to another device. For example, the virtual conversion apparatus 400 may transmit the stored mapping table to another device.
  • FIG. 5 is a ladder diagram for explaining a process of collecting storage information by a virtual storage device according to an exemplary embodiment of the present invention.
  • the virtual storage device 500 may collect and manage storage information of each device connected to a network in order to store the converted content. In addition, the virtual storage device 500 may transmit the storage capability and state information of each device connected to the network to the control point device 100 or the virtual conversion device 400.
  • the virtual storage device may be a separate storage device that is physically separated, but may also refer to a control point device, a media server, or a media renderer that can provide a media storage service on a network.
  • the virtual storage device may refer to a group of a plurality of devices that provide a virtual storage function.
  • the virtual storage device may include a MSCP (Medium Server Control Point) on the UPnP protocol for controlling the media server.
  • MSCP Medium Server Control Point
  • the virtual storage device 500 performs device discovery with each device connected to a network (S2100).
  • the device discovery process is as described above in the description of the virtual conversion device.
  • the virtual storage device 500 requests storage information from each of the networked devices (S2135, S2140, and S2145), and receives the storage information from the devices in response thereto (S2150, S2155, and S2160).
  • the storage information may include storage capability information and storage state information of each device.
  • the storage capability information may indicate a total storage space of each device, and the storage state information may indicate a storage space currently free for each device.
  • the virtual storage device 500 may collect such storage information and store the information in correspondence with the above-described device information. Therefore, the virtual storage device 500 may determine the storage capacity and the storage state of each device connected to the network based on the storage information.
  • the virtual storage device 500 receives a storage capacity and a storage state request from the control point device 100 (S2165), and transmits storage capacity and storage state information of each device in response thereto (S2170).
  • the virtual storage device 500 may classify and store the storage information for each device, and may transmit and store the storage capacity and the storage state of each device according to a request of the control point device 100.
  • the virtual storage device 500 may include a media server device (MSD) function defined by UPnP.
  • MSD media server device
  • FIG. 6 is a ladder diagram for explaining a process of collecting playback capability information by a virtual playback apparatus according to an exemplary embodiment of the present invention.
  • the virtual playback device 600 may collect and manage playback capability information of each device connected to the network in order to determine a playback capability of each playback device (media renderer) connected to the network.
  • the virtual storage device 500 may transmit the reproduction capability information of each device connected to the network to the control point device 100 or the virtual conversion device 400.
  • the virtual playback device may be a separate playback device that is physically separated, but may also refer to a control point device, a media server, or a media renderer that provides a virtual playback service on a network.
  • the virtual storage device may refer to a group of a plurality of devices that provide a virtual storage function.
  • the virtual storage device may include a MSCP (Medium Server Control Point) on the UPnP protocol for controlling the media server.
  • MSCP Medium Server Control Point
  • the virtual reproducing apparatus 600 performs device discovery with each device connected to a network (S2200).
  • the device discovery process is as described above in the description of the virtual conversion device.
  • the virtual reproducing apparatus 600 requests the reproducing capability information from each of the network-connected devices (S2235, S2240, and S2245), and receives the reproducing capability information from the respective devices in response thereto (S2250, S2255, and S2260). .
  • the reproduction capability information may include input profile information that each reproduction apparatus can reproduce.
  • the input profile information may include, for example, playable file format, bitrate, scale or rotation information.
  • the virtual reproducing apparatus 600 sends a protocol information request action (GetProtocolInfo ()) message of a connection management service (CMS) defined by UPnP to each reproducing apparatus connected to the network in order to request such reproduction capability information.
  • GetProtocolInfo () a protocol information request action
  • CMS connection management service
  • the virtual reproducing apparatus 600 may collect reproducing capability information in response to the reproducing capability information request and store the reproducing capability information in correspondence with the above-described device information. Accordingly, the virtual playback device 600 may collect, store, and manage the playback capabilities of the devices connected to the network.
  • the virtual reproduction apparatus 600 receives a reproduction capability information request from the control point apparatus 100 (S2165), and transmits reproduction capability information of each reproduction apparatus in response thereto (S2170).
  • the virtual reproducing apparatus 600 may classify and store the reproducing capability information for each device, and list and reproduce the reproducing capabilities for each device according to a request of the control point device 100.
  • the virtual playback device 500 may include a Media Renderer device (MRD) function defined by UPnP.
  • MRD Media Renderer device
  • FIG. 7 is a ladder diagram for explaining a process of converting content without storage by a control device and a control target device according to another embodiment of the present invention.
  • the virtual conversion apparatus 400 may include a control point.
  • the virtual conversion apparatus 400 may provide a conversion service by controlling devices connected to a network through a control point.
  • the virtual conversion apparatus 400 may register the devices connected to the network by performing the device discovery process described above before the content conversion process.
  • Devices connected to the network may include, for example, DMS1 (Digital Media Server 1), DMS2 (Digital Media Server 2), DMR (Digital Media Renderer), and the like, as shown in FIG.
  • the virtual conversion apparatus 400 registers device information (identification information, IP address, port number, etc.) of each device connected to the home network through a device discovery process, and requests a request message to be described later based on the registered device information. It may transmit to each device or receive a response message from each device.
  • the virtual conversion device 400 may access the DMS1 or the DMS2 based on the device information, and then receive and display the content information included in each device.
  • the present invention is not limited to the search target device.
  • the virtual conversion apparatus 400 requests content information from the DMS2 720, which is a search target device (S3000), and receives content information from the DMS2 720 in response thereto (S3005).
  • the virtual converter 400 requests protocol information from the DMR 730, which is a playback target device (S3010), and receives protocol information from the DMR 730 in response (S3015).
  • the content information request and response process and the contents included in the content information have been described above, and the protocol information request and response process and the contents included in the protocol information have been described above.
  • the virtual conversion apparatus 400 determines whether the user-selected content can be played back in the DMR 730 (S3020).
  • the virtual conversion apparatus 400 may display a content list included in the DMS2 720 based on the content information, and receive a content selection input that the user wants to play through the user interface. In addition, it may be determined whether the user-selected content is playable in the DMR 730 based on the profile information on the user-selected content and the protocol information received from the DMR 730.
  • the virtual conversion apparatus 400 may perform a general file streaming operation without a conversion process, or may transmit a message so that another control point device performs the general file streaming operation.
  • the virtual conversion device 400 requests conversion information from each device connected to the network.
  • the virtual conversion apparatus 400 requests the conversion information to the DMS2 720 (S3025), receives the conversion information of the DMS2 in response (S3030), requests the conversion information to the DMS1 710 (S3035), and In response to receiving the conversion information of the DMS1 (S3040), the DMR 730 also requests conversion information (S3045), and receives the conversion information of the DMR (S3050).
  • the request and response process of the conversion information is as described above.
  • the virtual conversion apparatus 400 may not only perform such a conversion information collection operation when the conversion is necessary, but also may repeatedly identify and store it in advance according to a predetermined period. Therefore, when the virtual conversion apparatus 400 requests and collects conversion information in advance, steps S3025 to S3050 may be omitted.
  • the virtual conversion device 400 determines an output profile.
  • the virtual conversion apparatus 400 may determine the outputable profiles when converting the profile of the user-selected content based on the conversion information of the collected devices.
  • the virtual conversion apparatus 400 may determine an output profile by selecting a profile that can be reproduced in the DMR 730 among the outputtable profiles based on the protocol information of the DMR 730.
  • the virtual conversion apparatus 400 may determine the output profile according to the priority, and the priority may include a plurality of preset output profile determination conditions. For example, the virtual conversion apparatus 400 may preferentially determine an output profile that can be converted in a media server (DMS2 in FIG. 7) or a media renderer (DMR in FIG. 7) to play the selected content. In addition, the virtual conversion apparatus 400 may convert and automatically determine one profile that is playable in the DMR 730 without user selection. In the case of two or more, the virtual conversion apparatus 400 selects a user through a user selection interface. It may be determined by receiving or automatically determined.
  • DMS2 media server
  • DMR media renderer
  • the virtual conversion device 400 determines the device to perform the conversion (S3060).
  • the virtual conversion apparatus 400 may select a device to perform conversion based on the conversion information for each device collected above. In addition, if it is determined that there are two or more devices that can perform the conversion, the virtual conversion device 400 may determine that the media server having the selected content or the media renderer having the selected content is the device to be converted first. And, if it is determined that there are two or more devices that can perform the conversion, the virtual conversion device 400 extracts the conversion performance information from the conversion information for each device, and preferentially performs the conversion on the device having the highest transformation performance. Can be determined by the device.
  • the virtual conversion device 400 determines whether to select storage (3065).
  • the virtual conversion apparatus 400 may determine whether to select a storage according to a preset condition, or may determine whether to select a storage based on a user input.
  • the virtual conversion apparatus 400 may query the user for storage selection and receive an input of storage selection through a user interface.
  • the storage selection input may include a command of any one of storing, not storing, or alternative storage of the converted content.
  • FIG. 7 a case in which the user inputs not to store is described. In other cases, the virtual conversion apparatus 400 performs a storage or replacement storage operation to be described later.
  • the virtual conversion apparatus 400 transmits a conversion start request to the DMS2 720 determined as the device to be converted (S3070), and receives the response (S3075).
  • the conversion start request message may include output profile information determined in steps S3055 and S3060 and device information to be converted.
  • the storage device information determined in operation S3065 may be further included, which will be described later.
  • the DMS2 720 starts the conversion (S3080) and starts the streaming of the converted content (S3085). Accordingly, the DMS2 720 performs file streaming of the converted content to the DMR 730 (S3090), and the DMR 730 receives and plays the content, thereby providing a service for playing the converted content to the user. .
  • the DMS2 720 may acquire content identification information, an input profile, and an output profile based on the streaming conversion start request message, and perform content conversion based on the content identification information.
  • the DMS2 720 may perform file streaming during the conversion process, or may perform file streaming after the conversion is completed for stable transmission.
  • the DMS2 720 may terminate the conversion (S3095) and terminate the streaming service.
  • FIG. 8 is a ladder diagram for describing a method of converting content between a control device and a control target device when alternative storage is selected according to another embodiment of the present invention.
  • Steps S3100 to S3160 of FIG. 8 are output device determination and conversion determination processes according to the same matching failures as steps S3000 to S3060 of FIG. 7 and will not be described in detail.
  • the virtual conversion apparatus 400 determines whether the user selects an alternative storage.
  • the user may input alternative storage into the virtual conversion apparatus 400 through the user interface.
  • the virtual conversion apparatus 400 may control the server device that has performed the conversion to replace the previous content with the converted content and store the converted content.
  • the virtual conversion apparatus 400 when the alternative storage is selected, the virtual conversion apparatus 400 generates a conversion start request message including an alternative storage command, and transmits it to the DMS2 720 (S3170).
  • the DMS2 720 Upon receiving the conversion start request, the DMS2 720 starts the conversion on the basis of the conversion start request message (S3180), and starts streaming and alternate storage of the converted content (S3185).
  • the DMR 730 receives and plays the received content and provides a streaming service in operation S3190.
  • the DMS2 720 may terminate the conversion, complete the alternative storage (S3095), and terminate the streaming service.
  • 9 to 14 are ladder diagrams for describing various examples of content conversion methods of a control device and a control target device when storage is selected according to another embodiment of the present invention.
  • the virtual transformation apparatus 400 performs the output profile determination process according to the matching failure as described above (S3200), and determines the apparatus to perform the transformation (S3205).
  • the virtual conversion apparatus 400 determines whether the user has selected to store the converted content. As described above, the virtual conversion apparatus 400 may determine whether to select storage based on a user input. If the storage is not selected, the virtual conversion device 400 determines not to store or substitute storage, and may perform an appropriate operation according to the above-described method.
  • the virtual storage device 500 requests the storage information to the DMS2 720 (S3215), receives the storage information of the DMS2 720 in response (S3220), and requests the storage information to the DMS1 (710) In operation S3225, the storage information of the DMS1 710 is received in operation S3230.
  • the order is not important, and may store the storage information of the DMS1 710 first. Also, steps S3215 to S3230 may be periodically performed by the virtual storage device 500.
  • the virtual storage device 500 may request storage information from all server devices connected to a network, and receive storage information of each device in response.
  • the virtual storage device 500 may receive, store, and manage storage information of the DMS1 710 and storage information of the DMS2 720. Accordingly, the most storage device 500 may determine the total storage space and available space of the DMS 710 and the DMS2 720, and store the data in the form of a table or a list.
  • the virtual conversion apparatus 400 when storage is selected, the virtual conversion apparatus 400 requests storage information from the virtual storage apparatus 500 in operation S3235.
  • the virtual storage device 500 transmits the storage information to the virtual conversion device 400 in response (S3240).
  • the virtual converter 400 may request storage information from the virtual storage device 500 to select a storage device.
  • the virtual conversion apparatus 400 may receive the storage information collected in advance by the virtual storage device 500 to obtain information on the total storage space and available space of the server devices 710 and 720.
  • the virtual conversion apparatus 400 displays a storage interface in operation S3245.
  • the virtual conversion apparatus 400 may display the storage interface based on the information about the total storage space and available space of each of the acquired server devices 710 and 720.
  • the storage interface may include, for example, a query menu for querying which device of the DMS1 710 and the DMS2 720 to store.
  • the storage interface may include a file naming menu of newly stored content when the converted file is newly stored.
  • the storage interface may include an automatic storage menu, and the virtual conversion apparatus 400 may select a server device and a file name according to a preset storage rule when selecting the automatic storage menu, and display the result to the user. .
  • the user may determine the storage capacity information of each DMS according to the output of the virtual conversion apparatus 400 and select a DMS to store the converted content through the storage interface.
  • the virtual conversion apparatus 400 receives a storage device selection input from a user (S3250), and selects a storage device based on the received storage device selection input (S3255).
  • a storage device selection input from a user (S3250)
  • S3255 selects a storage device based on the received storage device selection input (S3255).
  • the DMS2 720 is selected as a storage device by a user selection input, but the type of the storage device is not limited.
  • the virtual conversion device 400 transmits a conversion start request to the DMS2 720 determined as the device to be converted (S3260), and receives a response thereto (S3265).
  • the conversion start request message may further include information on a device for storing the converted content and a file name of the content to be stored, in addition to the above-described content identifier, input profile, and output profile.
  • the DMS2 720 Upon receiving the conversion start request, the DMS2 720 starts the conversion on the basis of the conversion start request (S3270). In operation S3280, the DMS2 720 starts streaming of the converted content, and stores the data of the converted content in its own storage space designated as the storage device. Accordingly, the converted content may be streamed to the DMR 730 and simultaneously stored in the DMS2 720. The DMR 730 may play the converted content that is streamed.
  • the DMS2 720 may complete the conversion and storage (S3290), specify a file name set by the user or a file name based on a preset rule, and correspond to the converted content.
  • FIG. 10 is a ladder diagram illustrating a case in which a device to be converted is determined as DMS2 720 and a user selects DMS1 710 as a storage device. Steps S3300 to S3355 are the same as the processes described with reference to FIG. 9, and thus description thereof will be omitted.
  • the virtual conversion device 400 When the user selects the DMS1 710 as the storage device, the virtual conversion device 400 first transmits a conversion start request to the DMS2 720, which is a device to perform conversion (S3360), and receives a response (S3365).
  • the conversion start request message may further include identification information of the DMS1 710, which is a device to be stored, and file name information to be assigned to the converted content, in addition to the content identifier, the input profile, and the output profile.
  • the DMS2 720 starts conversion (S3370) and starts streaming of the converted file (S3375).
  • the converted content is streamed (DMR 730) (S3380), thereby enabling real-time playback.
  • the DMS2 720 transmits a file constituting the converted content to the DMS1 710 which is a storage device (S3385).
  • the DMS1 710 stores the transmitted file in the storage space (S3390).
  • the DMS2 720 which is a device that performs conversion, may stream the converted content to the DMR 730, which is a playback device. At the same time, the DMS2 720 may also transmit the converted content to the DMS1 710 which is a storage device. Accordingly, efficient conversion, reproduction, and storage using home network resources is achieved.
  • the DMS2 720 may end the streaming, and the DMS1 710 may complete the storage of the converted content.
  • the device for storing the converted file may simultaneously perform streaming of the converted content. For example, if it is determined that the conversion performance of the DMS2 720 is low and it is difficult to simultaneously perform streaming, the virtual conversion apparatus 400 may designate a storage device to be streamed to the DMS1 710 and transmit the same.
  • FIG. 11 illustrates a case of simultaneously storing and streaming content converted in the DMS1 710.
  • operations S3400 to S3420 represent a process of starting a conversion through a process of determining an output profile according to a matching failure, and a process of determining a device to be converted and a storage device.
  • the DMS2 720 performing the conversion transmits the file constituting the converted content to the DMS1 710 which is a storage device (S3425).
  • the DMS1 710 receives and stores the converted content and performs streaming to the DMR 730 (S730). Thereafter, when the conversion is completed (3435), the DM1 710 may end the streaming, and complete the storage of the converted file with the specified file name.
  • the server device holding the content may not be able to convert the content to another format. Therefore, the virtual storage device 500 may determine that another server device performs the conversion in operation S3505 and the device to perform the conversion after determining the output profile according to the matching failure (S3500).
  • the virtual conversion apparatus 400 transmits a conversion start request message to the DMS1 710 and receives a response thereto (S3515).
  • the conversion start request message may include identification information of the content to be converted, and may further include conversion location information.
  • the translation location information may include identification information of the server device where the content to be converted is located, for example, URI information. Accordingly, the DMS1 710 may access the DMS2 720, which is a server device on which the content to be converted is located, based on the conversion start request message, identify the content to be converted (original content), and receive the same.
  • the DMS1 710 receives a file constituting the original content from the DMS2 720 (S3525). As described above, the DMS1 710 requests a file transfer to the DMS2 720 according to the conversion start request message received from the virtual conversion apparatus 400, or directly accesses the URI of the DMS2 720 to the DMS2 720. Can receive original content.
  • the DMS1 17 starts the conversion of the received original content (S3530).
  • the DMS1 17 performs streaming of the converted content and stores the converted content. Accordingly, the converted content is streamed from the DMS1 710 to the DMR 730, and the DMR 730 can play the streamed content.
  • the DMS1 710 may complete streaming and file storage and terminate the operation.
  • FIG. 13 illustrates a case where the DMS1 710 is determined to be a device to perform conversion when the selected original content is in the DMS2 720, and the DMS2 is selected as a storage device of the converted content.
  • the virtual conversion apparatus 400 determines an output profile to be converted and output (S3600), and determines a device to be converted and a storage device. (S3605). As illustrated in FIG. 13, the DMS1 710 may be determined as a device to be converted, and the DMS2 may be selected as a storage device of the converted content.
  • the virtual conversion apparatus 400 transmits a conversion start request to the DMS1 710 (S3610), and receives the response from the DMS1 710 (S3615). Then, the DMS1 710 receives the original content file from the DMS2 720 based on the conversion start request (S3625).
  • the conversion start request message may further include location information of the original content, in addition to identification information, input profile, output profile, and storage location information of the original content.
  • the location information of the original content may include path information for the server device performing the conversion to receive the original content through the home network.
  • the original content location information may include transmission URI information of the server device in which the original content is stored.
  • the conversion start request message may include path information for receiving the original content of the DMS2 720.
  • the DMS1 710 may request a file transfer from the DMS2 720 based on the location information of the original content, or access the DMS2 720 to receive the original content.
  • the DMS1 710 starts converting the original content (S3630) and performs streaming of the converted content (S3635). Accordingly, the DMS1 710 may stream the converted content to the DMR 730 (S3640), and the DMR 730 may play the streamed content.
  • the media renderer DMR 730 establishes a connection under the control of the virtual conversion apparatus 400 or the control point apparatus 100 and transmits the data. After the URI is set, when the play command is received, the content streamed from the DMS1 710 may be played.
  • the DMS1 710 transmits the file of the converted content to the selected DMS2 720 as the storage device.
  • the DMS1 710 may transmit the converted content to a specific location of the DMS2 720 based on the storage location information described above.
  • the DMS2 720 receives the converted content and stores it (S3650).
  • FIG. 14 is a ladder diagram illustrating a case where the selected content is stored in the DMS2 720, the DMS1 710 is determined to be a device to be converted, and the DMS2 720 is selected as the storage device.
  • the virtual conversion apparatus 400 determines an output profile according to a matching failure (S3700), determines a device to perform conversion according to the output profile, and determines a storage device (S3705).
  • the virtual conversion apparatus 400 transmits a conversion start request to the DMS1 710, which is a device to be converted (S3710), and receives a response (S3715). Thereafter, the DMS1 710 obtains the original content identification information, the original content location information, the input profile information, and the output profile information included in the conversion start request message, and accesses the DMS2 720 based on the original content location information.
  • the content is transmitted (S3725).
  • the DMS1 710 When transmission of the original content file is completed, the DMS1 710 starts the conversion of the original content (S3730). When the conversion is completed, the DMS1 710 transmits the converted file to the DMS2 720 (S3735).
  • the DMS1 710 may perform file transmission of the converted content after completion of conversion for stable streaming.
  • the DMS1 710 may stream the converted file data to the DMS2 720 at the same time as the conversion is performed for real time streaming.
  • the DMS2 720 upon receiving the converted file, performs streaming processing on the DMR 730 and stores the converted file (S3740). Accordingly, the converted content may be streamed to the DMR 730. The DMR 730 can then play the converted file that is streamed.
  • the virtual conversion apparatus 400 collects the conversion capability information of the devices connected to the network and receives and converts the storage information of the server devices connected to the network collected by the virtual storage device 500.
  • the device to be performed and the storage device can be determined. Accordingly, the virtual conversion apparatus 400 may enable efficient conversion and storage of content that cannot be played in the media renderer using devices connected to a network, and may improve user convenience.
  • 15 to 18 are ladder diagrams for describing content conversion methods of a control device and a control target device which perform conversion in advance according to another embodiment of the present invention.
  • the virtual storage device 500 requests content information from server devices connected to a network, and receives the content information in response (S4000).
  • the virtual storage device 500 may request, receive, store and manage content information of server devices connected to a network, for example, the DMS1 710 and the DMS2 720, as well as the storage information as described above. have.
  • the virtual reproduction apparatus 600 requests the reproduction capability information from the reproduction apparatuses connected to the network, and receives the reproduction capability information in response (S4000).
  • the virtual reproducing apparatus 600 stores the reproducing capability information as described above, and the reproducing capability information of server devices connected to the network, for example, digital media servers 1 and 750 (DMR1) and digital media servers 2 and 720 (DMS2). You can request it, receive it, store it, and manage it.
  • the reproduction capability information may include protocol information of each reproduction device, for example.
  • the virtual conversion device 400 requests content information from the virtual storage device 500 (S4015), and receives content information of each server device in response thereto (S4020).
  • the virtual conversion apparatus 400 requests the reproduction capability information from the virtual reproduction apparatus 600 (S4025), and receives the reproduction capability information of each reproduction apparatus in response thereto (S4030).
  • the process of transmitting and receiving the content information and the play command information is the same as described above and thus will be omitted.
  • the virtual conversion apparatus 400 determines the priority of the content to be converted, the device to be converted, and the storage device. Then, the content to be converted is selected according to the priority (S4040).
  • the virtual conversion apparatus 400 may assign priority to each server device, and may select content of a server device having a high priority as priority content to be converted.
  • the virtual conversion apparatus 400 receives content information from server devices connected to a network, and sets a highest priority value, for example, weight 3, for contents that cannot be played or smoothly played on a playback device. Can be assigned.
  • the virtual conversion apparatus 400 may assign a second priority value, for example, weight 2, to contents that are not immediately playable in the playback apparatus and that are not playable even if converted.
  • the virtual conversion apparatus 400 may assign a third priority value, for example, weight 1, to contents that are not immediately playable in the playback apparatus but are playable through the transformation.
  • the virtual conversion apparatus 400 may assign a fourth priority value, for example, weight 0, to the contents that can be played back in the playback apparatus.
  • the virtual conversion apparatus 400 may allocate a weight value for each content.
  • the virtual conversion apparatus 400 may select target content to be converted based on the assigned weight value.
  • the virtual conversion apparatus 400 may determine the reproduction capability corresponding to each reproduction apparatus based on the above-described weight value and the reproduction capability information of each reproduction apparatus. For example, the virtual converter 400 may assign a weight value corresponding to each content for each playback device connected to the network. The virtual conversion apparatus 400 may select the content having the highest value as the content to be converted by summing the weight values for each playback device of each content. Accordingly, the virtual conversion apparatus 400 can efficiently select the content that needs the most conversion.
  • the virtual converter 400 may set a factor for a frequently used playback device. For example, the virtual converter 400 may allocate Factor 1 to 3 according to the frequency of use of the playback device. The virtual conversion apparatus 400 may multiply the assigned Factor value by the above-described weight values for each playback device, and add the sum values to determine the priority value of each content. The virtual conversion apparatus 400 may select the content to be converted in order of highest priority value. Accordingly, the virtual conversion apparatus 400 may preferentially select content to be reproduced in the playback apparatus most frequently used to improve user convenience.
  • the virtual conversion apparatus 400 When the target content is selected, the virtual conversion apparatus 400 requests the conversion information to all devices connected to the network in order to convert the target content (S4050), and collects the conversion information in response thereto (S4055). Since the conversion information request and collection process of the virtual conversion apparatus 400 is as described above, it will be omitted.
  • the virtual conversion apparatus 400 determines an output profile for the target content in operation S4057.
  • the virtual converter 400 needs to set an output profile so that the playback device can play the target content smoothly.
  • the virtual conversion apparatus 400 may set a plurality of output profiles for user convenience, and generate and store the converted content of various formats, various scales, various bit rates, and various rotation states in advance for the same content. . Therefore, when the user wants to play the content after performing the conversion in advance, the virtual conversion apparatus 400 may determine the optimal converted content for playback and display or recommend some of the converted content to the user. have. Therefore, the user can immediately watch the content properly converted in the playback device without additional conversion process.
  • the virtual transformation apparatus 400 may determine an output profile based on the collected transformation information.
  • the virtual conversion apparatus 400 when content is selected according to the sum value X of the above-described weight values, the virtual conversion apparatus 400 based on each output profile, sums the sum values of the weight values when the selected content is converted to each output profile. We can calculate the calculated Y value and how much less it is than X. In addition, the virtual conversion apparatus 400 may determine the conversion to an output profile in the case where the largest Y value is large.
  • the virtual conversion apparatus 400 may select the selected content into each output profile based on each output profile.
  • the sum of the weight values in the transformed case is calculated by multiplying the factor value by the factor value, and the Y2 value calculated by how much less than X2 can be obtained.
  • the virtual conversion apparatus 400 may determine the conversion to an output profile in the case where the value of Y2 is the largest.
  • the virtual conversion device 400 determines the device to perform the conversion (S4060).
  • the virtual transformation apparatus 400 may determine the apparatus to perform the transformation based on the transformation information collected above. For example, the virtual conversion apparatus 400 may determine the device having the highest conversion performance as the device to perform the conversion. In addition, the virtual conversion apparatus 400 may determine a server device having original content as a device to perform conversion. The virtual conversion apparatus 400 may determine a server device to store the converted content as a device to perform the conversion. According to the various methods of determining the conversion performing apparatus as described above, the virtual conversion apparatus 400 may provide efficient conversion performance according to a situation. Such a determination method may be predetermined by the user, or may be preset when designing a home network.
  • the virtual storage device 500 requests the storage information to each of the storage server devices connected to the network, and receives the storage information in response (S4065).
  • the contents of the stored information and the request and reception process are the same as described above, and thus will be omitted.
  • the virtual conversion device 400 When the device to be converted is determined, the virtual conversion device 400 requests the storage information from the virtual storage device 500 (S4070), and receives the storage information in response thereto (S4075). The virtual conversion apparatus 400 determines the storage device based on the storage information (S4080).
  • the virtual conversion apparatus 400 may perform the conversion in advance without a user request. Therefore, the virtual conversion device 400 needs to determine the storage device without a user selection input.
  • the virtual conversion apparatus 400 may determine the server device having the largest storage space as the storage device based on the received storage information. In addition, when there are a plurality of server devices having a difference in storage space within a predetermined size, the virtual conversion device 400 may determine a server device storing original content as a storage device, thereby minimizing network resource waste.
  • the virtual conversion apparatus 400 may determine a non-portable device as a storage device in consideration of user convenience according to whether the server device is portable. This is because a user often stores only essential content in a portable device.
  • the virtual conversion apparatus 400 may obtain identification information of the server devices through the device discovery, and determine whether the portable device is portable based on the identification information. For example, the virtual conversion apparatus 400 may determine model names of server devices through device discovery, and determine whether the model is portable by comparing the portable model table with previously stored models.
  • the virtual conversion device 400 may determine whether to store the converted content as new content according to its own file name assignment rule. In contrast, the virtual conversion apparatus 400 may determine whether to store the converted content as an additional resource corresponding to the original content object.
  • the virtual conversion device 400 transmits a conversion start request to a device to perform conversion (S4085).
  • the conversion start request can be sent in advance without user input.
  • the conversion start request message may include, as input variables, identification information of the target content, location information of the target content, input profile information, output profile information, identification information of the storage device, and storage location information.
  • the virtual conversion apparatus 400 may generate a conversion start request message according to the results of S4035, S4040, S4057, S4060, and S4080 described above, and transmit the converted start request message to the device to perform the conversion.
  • the DMS2 720 which is a device to be converted, performs the conversion according to the conversion start request message in operation S4090 and stores the converted content in a storage location of the DMS2 720 in operation S4095.
  • the virtual conversion apparatus 400 may perform the conversion in advance without a user request to distribute the load of the network, and may improve convenience when a user wants to play content.
  • FIG. 16 illustrates a case in which the DMS2 720 is determined as a device to perform the conversion in advance, and the DMS1 710 is determined as the storage device.
  • the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4100). In operation S4110, a conversion start request is transmitted to the DMS2 720.
  • the DMS2 720 performs the conversion according to the conversion request message (S4120), and transmits the converted content file to the DMS1 710, which is a storage device (S4130). Accordingly, the DMS1 710 stores the received file and completes storing the converted content file (S4140).
  • FIG. 17 illustrates a case in which the DMS1 710 is determined as a device and a storage device to perform conversion in advance.
  • the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4200). Then, the conversion start request is transmitted to the DMS1 710 (S4210).
  • the DMS1 710 performs a conversion according to the conversion request message (S4220), and stores the converted content file (S4230).
  • FIG. 18 illustrates a case in which the DMS1 710 is determined as a device to perform the conversion and the DMS2 720 is determined as the storage device in advance.
  • the virtual conversion device 400 receives information from other devices and determines a device and a storage device to be converted (S4300). Then, the conversion start request is transmitted to the DMS1 710 (S4310).
  • the DMS1 710 performs the conversion according to the conversion request message (S4320), and transmits the converted content file to the storage location of the determined DMS2 720 to the storage device (S4330).
  • the DMS2 720 When the DMS2 720 receives the converted content file, the DMS2 720 performs storage (S4230).
  • 19 is a flowchart illustrating a method of operating a virtual transformation apparatus 400 that performs transformation in advance according to an embodiment of the present invention.
  • the virtual conversion apparatus 400 determines whether there is content previously converted for content that cannot be played back (S4400). When there is no pre-converted content, the virtual conversion apparatus 400 may perform the conversion as described above.
  • the virtual conversion apparatus 400 may display a profile information list of the converted contents.
  • the virtual conversion apparatus 400 may determine the content converted to be suitable for the playback device to be played by the user and recommend the content to the user.
  • the virtual conversion apparatus 400 receives a selection input of content to be reproduced among the converted content from the user.
  • the virtual conversion apparatus 400 controls the server apparatus to stream the converted content corresponding to the selection input to the playback apparatus, and controls the playback apparatus to play the streamed content (S4430). Accordingly, even in the case of the content that cannot be reproduced by the playback device, the virtual conversion device 400 can inform the user of the pre-converted content, and induce proper selection of the user to enable smooth content playback.
  • 20 to 26 are diagrams illustrating a user interface output according to a content conversion method according to an embodiment of the present invention.
  • the virtual conversion apparatus 400 or the control point apparatus 100 displays a list of contents included in each server device through a user interface based on the content information, and selects content through the user interface. An input can be received.
  • FIG. 21 illustrates a query interface indicating whether to convert selected content when a playback device cannot reproduce the content according to an embodiment of the present invention.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may determine whether the playback apparatus can play the selected content based on the playback capability information.
  • the virtual transformation apparatus 400 or the control point apparatus 100 may receive a transformation input through a query interface, and perform the transformation accordingly.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may display a storage interface for querying whether to store content to be converted and receive a user input thereto. The user can select either save, no save or alternate save via the storage interface.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may display a device to be converted to the user. 22 shows that the device to be converted is determined to be Device2.
  • the virtual conversion apparatus 400 or the control point apparatus 100 displays available storage spaces based on the storage information received from the virtual storage apparatus 500, and stores which device to store.
  • the device selection input may be received from the user through the storage device selection interface.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may select the storage device by itself through the above-described method.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may receive the conversion progress information and transmit the converted progress information to the media renderer, and the media renderer may display the conversion progress status on the playback screen based on this.
  • the server device that performs the converted content streaming may collect such conversion progress information and insert it into the streamed content.
  • the conversion from the MP4 format to the WMV is performed in Device 1, and the storage in Device 2 is 80% in progress.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may not play the current content, but if there are a plurality of pre-converted contents, the virtual transformation apparatus 400 or the control point apparatus 100 may display the converted content selection interface for selecting any one of them. .
  • Content2 may be converted into three types: MP4, high definition version of 720p, medium definition version of AVI 480p, and WMV, low definition version of 240p.
  • the user can select a desired version of the converted content.
  • the virtual conversion apparatus 400 or the control point apparatus 100 may determine and recommend an optimal version that can be smoothly reproduced by the reproducing apparatus. In Fig. 25, it is determined that the playback device is a high performance device, and that MP4 and 720p versions are recommended.
  • FIG. 26 is a block diagram illustrating a configuration of a control device or a control target device according to an embodiment of the present invention.
  • control point device 100 will be described with reference to FIG. 26.
  • the block diagram of FIG. 26 may be applied to the media server 200, the media renderer 300, the DMS, or the DMR, which are control target devices.
  • the control point device 100 and the control target device may be represented by a terminal.
  • the control point device 100 may include a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface.
  • the unit 170, the controller 180, and the power supply unit 190 may be included.
  • the components shown in FIG. 26 are not essential, so that a control point device having more or fewer components may be implemented.
  • the wireless communication unit 110 may include one or more modules that enable wireless communication between the control point device 100 and the wireless communication system or between the control point device 100 and the network in which the control point device 100 is located.
  • the wireless communication unit 110 may include one or more broadcast receiving modules 111, one or more mobile communication modules 112, one or more wireless Internet modules 113, one or more local area communication modules 114, and one or more location information. Module 115, and the like.
  • the terminal can connect to the network through this communication module.
  • the wireless communication unit 110 may transmit or receive the above-described message or device information through multicast or unicast under the control of the controller 180.
  • the collected device information is stored in the memory 160.
  • the broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.
  • the broadcast channel may include a satellite channel and a terrestrial channel.
  • the broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal.
  • the broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.
  • the broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider.
  • the broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.
  • the broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).
  • EPG Electronic Program Guide
  • DMB Digital Multimedia Broadcasting
  • ESG Electronic Service Guide
  • DVB-H Digital Video Broadcast-Handheld
  • the broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H).
  • Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T).
  • ISDB-T Handheld and Integrated Services Digital Broadcast-Terrestrial
  • the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.
  • the broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.
  • the mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.
  • the wireless internet module 113 refers to a module for wireless internet access, and may be embedded or external to the control point device 100.
  • Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.
  • the short range communication module 114 refers to a module for short range communication.
  • Bluetooth Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • ZigBee ZigBee
  • the location information module 115 is a module for obtaining a location of a terminal, and a representative example thereof is a GPS (Global Position System) module.
  • GPS Global Position System
  • the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122.
  • the camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode.
  • the processed image frame may be displayed on the display unit 151.
  • the image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.
  • the microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data.
  • the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode.
  • the microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.
  • the user input unit 130 generates input data for the user to control the operation of the terminal.
  • the user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.
  • the sensing unit 140 may determine the current state of the control point device 100 such as an open / closed state of the control point device 100, a position of the control point device 100, presence or absence of user contact, orientation of the terminal, acceleration / deceleration of the terminal, and the like.
  • the sensing unit generates a sensing signal for controlling the operation of the control point device 100. For example, when the control point device 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed.
  • the sensing unit 140 may include a proximity sensor 141.
  • the output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.
  • the display unit 151 displays (outputs) information processed by the control point apparatus 100. For example, when the terminal is in a call mode, the terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the control point device 100 is in a video call mode or a shooting mode, the control point device 100 displays a captured image and / or a received image, a UI, or a GUI.
  • UI user interface
  • GUI graphic user interface
  • the display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.
  • LCD liquid crystal display
  • TFT LCD thin film transistor-liquid crystal display
  • OLED organic light-emitting diode
  • flexible display flexible display
  • Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display.
  • a representative example of the transparent display is TOLED (Transparant OLED).
  • the rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.
  • two or more display units 151 may exist.
  • a plurality of display units may be spaced apart or integrally disposed on one surface of the control point device 100, or may be disposed on different surfaces.
  • the display unit 151 and a sensor for detecting a touch operation form a mutual layer structure (hereinafter, referred to as a touch screen)
  • the display unit 151 may be configured in addition to an output device. Can also be used as an input device.
  • the touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.
  • the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal.
  • the touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.
  • the touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.
  • a proximity sensor 141 may be disposed in an inner region of the terminal surrounded by the touch screen or near the touch screen.
  • the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays.
  • the proximity sensor 141 has a longer life and higher utilization than a contact sensor.
  • Examples of the proximity sensor 141 include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.
  • the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer.
  • the touch screen may be classified as a proximity sensor.
  • the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch
  • the act of actually touching the pointer on the screen is called “contact touch.”
  • the position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.
  • the proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state).
  • a proximity touch and a proximity touch pattern for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state.
  • Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.
  • the sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.
  • the sound output module 152 may also output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the control point device 100.
  • the sound output module 152 may include a receiver, a speaker, a buzzer, and the like.
  • the alarm unit 153 outputs a signal for notifying occurrence of an event of the control point device 100. Examples of events occurring in the terminal include call signal reception, message reception, key signal input, and touch input.
  • the alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration.
  • the video signal or the audio signal may be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.
  • the haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154.
  • the intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.
  • the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like.
  • Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.
  • the haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm.
  • the haptic module 154 may be provided with two or more according to the configuration aspect of the terminal.
  • the memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.).
  • the memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.
  • the memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk.
  • the control point device 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.
  • the interface unit 170 serves as a path with all external devices connected to the control point device 100.
  • the interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the control point device 100, or transmits data inside the control point device 100 to an external device.
  • wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.
  • the identification module is a chip that stores various types of information for authenticating the use authority of the control point device 100.
  • the identification module includes a user identification module (UIM), a subscriber identity module (SIM), and a universal user authentication module. (Universal Subscriber Identity Module, USIM) and the like.
  • a device equipped with an identification module hereinafter referred to as an 'identification device' may be manufactured in the form of a smart card. Therefore, the identification device can be connected to the terminal through the port.
  • the interface unit may be a passage through which power from the cradle is supplied to the terminal when the terminal is connected to an external cradle, or a passage through which various command signals input from the cradle by a user are transmitted to the terminal.
  • Various command signals or power input from the cradle may be operated as signals for recognizing that the terminal is correctly mounted in the cradle.
  • the controller 180 typically controls the overall operation of the terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like.
  • the controller 180 may include a multimedia module 181 for playing multimedia.
  • the multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.
  • the controller 180 performs the determination and determination described with reference to FIGS. 2 to 20. That is, the controller 180 may perform each step shown in FIGS. 2 to 20 while controlling the wireless communication unit 110.
  • the controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.
  • the power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.
  • Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.
  • the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. These may be implemented by the controller 180.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed.
  • the software code may be implemented by a software application written in a suitable programming language.
  • the software code may be stored in the memory 160 and executed by the controller 180.
  • the above-described method may be implemented as code that can be read by a processor in a medium in which a program is recorded.
  • processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Computer And Data Communications (AREA)
  • Small-Scale Networks (AREA)

Abstract

Dans l'un de ses modes de réalisation, la présente invention se rapporte à un procédé de commande d'un appareil de contrôle. L'appareil de contrôle comprend un procédé qui est adapté pour fournir un service de conversion de contenu au moyen d'un appareil de contrôle cible. Ledit procédé comprend les étapes consistant : à rechercher des appareils de contrôle cible connectés à un réseau domestique ; à sélectionner l'un quelconque parmi des contenus stockés dans un appareil formant serveur, sur la base de données de contenu reçues d'au moins un appareil formant serveur parmi les appareils recherchés ; à déterminer, sur la base d'informations de protocole reçues d'au moins un appareil de rendu parmi les appareils recherchés et sur la base desdites données de contenu, si le contenu sélectionné peut être reproduit, ou non, par l'appareil de rendu ; et, si le contenu sélectionné ne peut pas être reproduit, à transmettre une demande de débuter une conversion du contenu sélectionné à l'un quelconque des appareils faisant partie des appareils recherchés.
PCT/KR2012/004467 2011-06-07 2012-06-07 Appareil de contrôle, appareil de contrôle cible et procédé pour convertir un contenu au moyen de ce dernier Ceased WO2012169780A2 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201161493984P 2011-06-07 2011-06-07
US61/493,984 2011-06-07
US201161506153P 2011-07-10 2011-07-10
US61/506,153 2011-07-10
US201161527086P 2011-08-24 2011-08-24
US61/527,086 2011-08-24

Publications (2)

Publication Number Publication Date
WO2012169780A2 true WO2012169780A2 (fr) 2012-12-13
WO2012169780A3 WO2012169780A3 (fr) 2013-03-28

Family

ID=47296586

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2012/004467 Ceased WO2012169780A2 (fr) 2011-06-07 2012-06-07 Appareil de contrôle, appareil de contrôle cible et procédé pour convertir un contenu au moyen de ce dernier

Country Status (1)

Country Link
WO (1) WO2012169780A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023134284A1 (fr) * 2022-01-13 2023-07-20 腾讯科技（深圳）有限公司 Procédé et appareil de commande d'objet virtuel, dispositif informatique et support de stockage

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100754431B1 (ko) * 2006-04-10 2007-08-31 삼성전자주식회사 Ｄｌｎａ 시스템에서 ｄｍｒ의 처리용량에 따른 컨텐츠변환방법
CN101350808B (zh) * 2007-07-19 2012-07-04 华为技术有限公司 实现媒体内容转换的方法、系统和装置
CN102804818A (zh) * 2009-06-15 2012-11-28 诺基亚公司 用于提供订源中的媒体附件兼容的方法和装置
KR20110005449A (ko) * 2009-07-10 2011-01-18 주식회사 케이티 Ｄｌｎａ 시스템 기반 컨텐츠 변환 시스템 및 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023134284A1 (fr) * 2022-01-13 2023-07-20 腾讯科技（深圳）有限公司 Procédé et appareil de commande d'objet virtuel, dispositif informatique et support de stockage

Also Published As

Publication number Publication date
WO2012169780A3 (fr) 2013-03-28

Similar Documents

Publication Publication Date Title
WO2014014308A1 (fr) Procédé et système de partage de contenu, dispositif et support d'enregistrement lisible par ordinateur pour mettre en œuvre le procédé
WO2015178611A1 (fr) Serveur et procédé de fourniture de services de collaboration et terminal utilisateur permettant de recevoir des services de collaboration
WO2013058423A1 (fr) Dispositif électronique et procédé servant à commander le dispositif électronique
WO2017043784A1 (fr) Terminal mobile et procédé de commande dudit terminal
WO2014017759A1 (fr) Procédé et terminal mobile permettant d'afficher des informations, procédé et dispositif d'affichage permettant de fournir des informations, et procédé et terminal mobile permettant de générer un signal de commande
WO2016018086A1 (fr) Système et procédé de gestion de métadonnées
WO2012026651A1 (fr) Procédé de synchronisation de contenus et dispositif d'affichage permettant le procédé
WO2017146438A1 (fr) Appareil d'affichage et procédé de paramétrage du canal opérationnel dudit appareil
WO2014098441A1 (fr) Système et procédé de commande de dispositifs environnants basés sur la topologie
WO2014182043A1 (fr) Système et procédé destinés à fournir du contenu à un appareil en fonction de l'emplacement de l'appareil
WO2017135585A2 (fr) Haut-parleur principal, haut-parleur secondaire et système comprenant ceux-ci
WO2016085094A1 (fr) Dispositif multimédia et procédé de commande associé
WO2014204272A1 (fr) Procédé et appareil pour reproduire des contenus multimédias à l'aide de bluetooth dans un système de communication sans fil
WO2012067344A2 (fr) Procédé de navigation sur la toile et dispositif d'affichage d'images l'utilisant
WO2021132757A1 (fr) Appareil d'affichage
WO2016072565A1 (fr) Dispositif de sortie d'image, terminal mobile et procédé de commande associé
WO2019221365A1 (fr) Téléviseur flexible et procédé associé
WO2020149426A1 (fr) Dispositif d'affichage d'image et son procédé de commande
WO2012074189A1 (fr) Procédé de commande d'affichage sur écran et dispositif d'affichage d'image l'utilisant
WO2016175361A1 (fr) Dispositif d'affichage et son procédé de commande
WO2017200215A1 (fr) Terminal mobile et procédé de commande de celui-ci
WO2013065930A1 (fr) Appareil multimédia, serveur de contenu et procédé pour les faire fonctionner
WO2012099370A2 (fr) Appareil de commande, appareil cible de commande, et procédé de réglage d'alarme utilisant les appareils
WO2012096505A2 (fr) Appareil de commande, appareil cible de commande, et procédé pour faire fonctionner l'appareil de commande et l'appareil cible de commande dans de multiples réseaux
WO2012070742A1 (fr) Procédé d'installation d'applications, et dispositif d'affichage d'images utilisant celui-ci

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12796723

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12796723

Country of ref document: EP

Kind code of ref document: A2