JP6543155B2 - Operation control device and program - Google Patents

Description

  The present invention relates to an operation control device of a karaoke system which reproduces musical tones for karaoke and causes a user to perform karaoke and a program thereof.

  In recent years, karaoke that the user sings along with the outputted musical tones, which reproduces music data consisting only of accompaniment (so-called music data for karaoke), is recognized as entertainment and hobbies.

  Also, recently, as a new way of enjoying karaoke, sound effects such as applause, cheers, instrumental sounds, or jealousy while singing karaoke, effects such as decorative images or stamp-like images on the background image during singing A service has also appeared in which an image is output (speaking or superimposing) while another user who is not singing or singing user sings by himself.

  In particular, as a system for realizing such a service, a karaoke apparatus is known which outputs sound effects stored in advance during reproduction of music data for karaoke and causes an effect image stored in advance to be superimposed on a background image. (E.g., Patent Document 1).

JP 2005-173080 A

  However, in the system described in Patent Document 1, it is often difficult to allow the user to select easily when the number of sound effects and effect images to be added increases. In particular, recently, in order to boost the atmosphere of the place, available sound effects and effect images have increased dramatically, but in addition to the genre of the music being played, there are choruses, interludes, or tunes etc. Depending on the state of reproduction of the system, the ones that can be used are also limited, and a mechanism for accurately selecting an appropriate one at the time of selection is also desired.

  The present invention has been made to solve the above-mentioned problems, and an object thereof is to select appropriate data for enhancing the atmosphere of a place when selecting presentation effect data such as sound effects and effect images. It is an object of the present invention to provide an operation control apparatus for a karaoke system which can be easily selected and which can improve the convenience of the user.

  In order to solve the above-mentioned subject, the present invention is an operation control device which operates a karaoke system which performs reproduction of music for karaoke, and displays data and an effect image which output sound effects during reproduction of the music. Identification effect information specifying at least one of the rendering effect data or the presentation effect data, and attribute information indicating a component part attribute indicating an attribute of a component part configuring the music are stored in association with each other Means for managing the storage means, and information reproduced from the karaoke system during reproduction of the music, the reproduction status indicating the reproduction status of the music including at least the component part attribute of the music being reproduced Among the effect means data stored in the storage means, the configuration means included in the received reproduction status information, among the reception means for receiving information, and the effect data stored in the storage means. Selection means for specifying the presentation effect data having an attribute that matches or is associated with an attribute as selectable data that can be selected by the user, and data for selecting predetermined presentation effect data from among the specified selectable data And a transmission unit for transmitting an instruction to output the received selection data to the karaoke system.

  Further, in order to solve the above problems, the present invention is an operation control device for operating a karaoke system for reproducing music, which is at least one of data for outputting a sound effect and data for displaying an effect image. Storage means in which the rendering effect data, identification information for identifying the rendering effect data, and component part attribute information indicating attributes of component parts making up the music are stored in association with each other; Acquisition means for correlating an analysis result obtained by executing a predetermined analysis with a component part and acquiring it in advance before reproduction, and a sound collection means for collecting the musical tone outputted from the karaoke system during reproduction of the music And performing the predetermined analysis on the collected tones and recognizing the reproduction point based on the analysis result, and the recognized reproduction point belongs The recognition effect means for specifying the component part and the effect data having an attribute corresponding to or associated with the specified component part among the plurality of effect data stored in the storage means, Specifying means for specifying as selectable data selectable by the user; and receiving means for receiving an instruction input of the user for selecting predetermined rendering effect data as selection data from among the specified selectable data And transmitting means for associating the output instruction of the received selection data with the identification information of the effect effect data and transmitting the instruction to the karaoke system in which the effect effect data is stored. There is.

  The present invention automatically identifies data suitable for use from among a plurality of sound effects and effect image effect data based on the reproduction status during reproduction of music for karaoke, and presents the data in a selectable manner to the user Therefore, the user can select appropriate data for enhancing the atmosphere of the place, and the complexity of the operation when selecting the effect data can be eliminated, and the convenience of the user can be improved. . In particular, the present invention allows the user to select rendering effect data appropriately and easily, even though many rendering effect data may be provided.

It is a system configuration figure showing the composition of one embodiment in the karaoke communication system concerning the present invention. It is a conceptual diagram which shows the operation | movement outline | summary of the karaoke communication system 1 in one Embodiment. It is a block diagram showing composition of a karaoke system of one embodiment. It is a figure which shows an example of the presentation effect data memorize | stored in the database for systems of one Embodiment. It is a figure which shows an example of the reproduction | regeneration information produced | generated by the data processing part of one Embodiment. It is a block diagram which shows the structure of the communication terminal device in one Embodiment. It is an example of the table data memorize | stored in the data storage part in one Embodiment. It is an example of the selection screen at the time of selecting the presentation effect data displayed on the communication terminal device in one embodiment. It is a flowchart (the 1) which shows operation | movement of the presentation effect data selection control processing performed in the remote control device of one Embodiment. It is a flowchart (the 2) which shows operation | movement of the presentation effect data selection control processing performed in the remote control device of one Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below relates to the present invention for a karaoke communication system having a karaoke system for reproducing karaoke data, a remote control device for operating and controlling the karaoke system, and a management server device for managing each karaoke system. The embodiment is an embodiment in which the operation control device and its program are applied.

[1] Karaoke Communication System [1.1] Outline of Karaoke Communication System First, an outline of the karaoke communication system 1 of the present embodiment will be described with reference to FIGS. 1 and 2.

  FIG. 1 is a system configuration diagram showing a configuration of the karaoke communication system 1 in the present embodiment, and FIG. 2 is a conceptual diagram showing an operation outline of the karaoke communication system 1 in the present embodiment.

  Moreover, in order to prevent that a figure becomes complicated, in FIG.1 and FIG.2, only a one part user and a part entertainment facility (henceforth a "store") are shown. That is, in the actual karaoke communication system 1, there are more karaoke systems 10, users, and remote control devices 20 than displaying.

  The karaoke communication system 1 according to the present embodiment includes, for example, a karaoke system 10 installed in the room 50 of a store consisting of a plurality of karaoke boxes, a remote control device 11 for operating the corresponding karaoke system 10, and karaoke data Service for managing users, and a storage device 40 in which various databases (hereinafter referred to as "DB") are constructed, and services related to karaoke for users (hereinafter referred to as "Karaoke providing service") It is a system that provides.

  In particular, when using the karaoke system 10, the karaoke communication system 1 of the present embodiment uses information (hereinafter referred to as "reproduction status information") indicating the playback status provided from the karaoke system 10. It is a system which can specify presentation effect data suitable for the place from presentation effect data, such as a plurality of sound effects or effect images stored in advance, and can selectably present the user.

  Therefore, the karaoke communication system 1 according to the present embodiment allows the user to easily select an appropriate sound effect or effect image that enhances the atmosphere of the place, and eliminates the complexity of the operation at the time of the selection. Convenience can be improved.

  In FIG. 1, the storage device 40 is directly connected to the network N so that the karaoke system 10 can directly access each database in the storage device 40 (hereinafter, the database is referred to as “DB”). The storage device 40 may be mounted in the management server device 30.

  The network N is configured, for example, by interconnecting a public telephone network including a mobile telephone network and an IP (Internet Protocol) network. However, the configuration of the network N is not limited to this.

  Furthermore, although the management operation subject of the storage device 40 may be provided with a dedicated computer, in the present embodiment, in order to embody the explanation, the management operation is performed by the management server device 30. .

[1.2] Configuration of Karaoke Communication System The karaoke system 10 is a device for realizing various karaoke functions such as a home game machine or a personal computer, in addition to the devices in each room 50 of the store. .

In particular, the karaoke system 10
(1) An acquisition function of acquiring specific karaoke data from the storage device 40 based on the user's music selection,
(2) A karaoke data reproducing function of reproducing the karaoke data acquired from the storage device 40 or the karaoke data stored in advance to output musical tones and displaying the lyrics of the music along with the output of musical tones,
(3) Background image data held in advance (hereinafter referred to as "background image data") or background image data acquired from the storage device 40 (in synchronization with the output of the musical tone pertaining to the same music by other users) Background image reproduction function for displaying image data (including collaboration image data) which is singing (collaborating) in synchronization with the outputted musical tone, and
(4) A scoring function to score users who have sung after the end of the song or at other timings,
have.

In addition, the karaoke system 10, during playback of the karaoke data,
The reproduction status of the music including at least information on the music being reproduced (hereinafter referred to as “music information”), and (B) a configuration part of the music being reproduced (hereinafter referred to as “configuration part attribute”) Indicates playback status information,
Is transmitted to the remote control device 11 as reproduction information.

  The remote control device 11 is a controller that constitutes a part of the karaoke system 10, and receives an instruction input from the user, and transmits to the karaoke system 10 a music selection number and the like for selecting karaoke data according to the instruction input. have.

  In particular, the remote control device 11 is configured to configure the music effect effect ID for specifying presentation effect data of at least one of data for outputting a sound effect and data for displaying an effect image during reproduction of karaoke data. Attribute information indicating part attributes is associated with each other and stored in a memory (storage unit 160 described later).

Then, the remote control device 11
(1) Identify appropriate rendering effect data from among a plurality of rendering effect data stored in advance, based on the reproduction information as described above provided from the karaoke system 10,
(2) The user can selectably present the sound effect or the effect image to the user based on the specified effect data,
(3) When selected by the user from among the presented ones, the karaoke system 10 is operated and controlled to output the selected effect data.
A process (hereinafter, referred to as "effect effect data selection control process") is performed.

  The remote control device 11 may use, for example, a communication terminal device such as a smartphone, a portable telephone, and a tablet information communication terminal device on the assumption that the remote control device 11 is registered for use in the corresponding karaoke system 10.

  Also, in this case, the remote control device 11 acquires resource data described in a markup language such as XML (extensible Markup Language) or JSON (JavaScript (registered trademark) Object Notation) based on the URL, and Based on the acquired resource data, it has a browsing function for displaying an image, reproducing a sound, and performing data communication, and the operation control of the karaoke system 10 is performed using the function.

  The management server device 30 is a server device that manages various services including the karaoke providing service provided to the user in the karaoke communication system 1 while managing the storage device 40.

  In particular, the management server device 30 manages various data of user information and karaoke data stored in the storage device 40, and reads out the requested various data from the storage device 40 in accordance with the request from the karaoke system 10 10 has a configuration for delivering.

  The storage device 40 is configured by an HDD (hard disk drive) or an SSD (solid state drive) or the like, and a user management DB 401 and a karaoke data DB 402 are constructed in the storage area and managed and operated by the management server device 30. It has become so.

  The user management DB 401 is a DB in which information for managing each user (hereinafter referred to as "user information") is stored as data.

  Specifically, a plurality of user information stored in the user management DB 401 includes a user ID for identifying each user, a name, an address, an account name, a password, a gender, an age, an e-mail address, and a favorite image (that is, a background An image to be used as an image is associated as data and stored.

  The karaoke data DB 402 includes genre data indicating hierarchical music genres of karaoke data such as "Enka", "POP", "Lock", a song selection number for identifying each karaoke data, and a song title A plurality of karaoke data associated with each other is stored. Some karaoke data are stored in the karaoke system 10.

  Further, the karaoke data includes music data for karaoke, lyric data to be displayed in synchronization with reproduction of the music data during reproduction of the karaoke data, control data for performing display control of the lyric data, and the like. .

  Furthermore, MIDI (Musical Instrument Digital Interface) data for reproducing and controlling the performance sounds of a plurality of musical instruments, composition parts indicating composition of music such as A melody, B melody, and rust, and song parts are included in music data for karaoke. It includes pitch data indicating the pitch of the reference sound (key) and guide melody data for guiding the melody.

[1.3] Outline of Operation of Karaoke Communication System When the karaoke system 10 receives a use start instruction of a rendering effect image transmitted from the remote control device 11 through the management server device 30 ([1] and [2 in FIG. ), During playback of song data for karaoke (ie, karaoke data), attributes of constituent parts of the song being played, such as A melody or rust, until playback of the karaoke data is ended (hereinafter, The reproduction status information such as “configuration part attribute” is directly transmitted to the remote control device 11 ([3] in FIG. 2).

Then, when the remote control device 11 receives the reproduction status information transmitted from the karaoke system 10,
(1) Out of the stored effect data, the effect data that allows the user to select the effect data having information matching or related to the received reproduction status information (hereinafter, "selectable effect data") Identified as (4) in Figure 2).
(2) When the user's instruction input for selecting predetermined presentation effect data as the selected presentation effect data from among the selected selectable presentation data is received ([5] in FIG. 2),
(3) The output instruction of the accepted selection effectable data is transmitted to the karaoke system 10 via the management server device 30 ([6] and [7] in FIG. 2).

  On the other hand, when receiving the output instruction of the selected effect data, the karaoke system 10 executes output control of the corresponding selected effect data ([8] in FIG. 2).

  In particular, when the output instruction of the received selected effect data is the sound effect data, the karaoke system 10 outputs the sound effect indicated by the sound effect data, and the received selected effect data is the effect image data. The control image is displayed by superimposing the effect image indicated by the effect image data on the background image.

  When the received rendering effect data is effect image data, the karaoke system 10 ends the displayed effect image at a predetermined timing or a performance end timing.

  With such a configuration, the karaoke communication system 1 according to the present embodiment automatically generates data suitable for use out of a plurality of effect sound and effect image effect data based on the reproduction status during reproduction of karaoke data. Since the user can select and present to the user, it is possible to allow the user to select an appropriate sound effect or effect image that excites the atmosphere of the place, and can be selected easily to improve user convenience. It can be done.

  In particular, the karaoke communication system 1 according to the present embodiment can allow the user to select presentation effect data appropriately and easily even if many presentation effect data can be provided as in the present embodiment. It is supposed to be.

  Although the data communication from the remote control device 11 to the karaoke system 10 is performed via the management server device 30 in the above description, even if the remote control device 11 directly executes the karaoke system 10 Good.

[2] Karaoke System Next, the configuration and operation of the karaoke system 10 of the present embodiment will be described using FIGS. 3 to 5. In addition, FIG. 3 is a block diagram which shows the structure of the karaoke system 10 in this embodiment, and FIG. 4 is a figure which shows an example of the presentation effect data memorize | stored in DB119 for systems. FIG. 5 is a diagram showing an example of reproduction information generated by the data processing unit 120. As shown in FIG.

  As shown in FIG. 3, the karaoke system 10 according to the present embodiment includes, from the microphone M, a communication control unit 111 that performs communication for acquiring karaoke data and music image data from the management server device 30 via the network N. A voice input processing unit 112 that performs predetermined processing on the output voice signal, a karaoke reproduction unit 113 that reproduces music data included in karaoke data, and a speaker SP that amplifies a musical tone corresponding to the reproduced music data And a loud-sound processing unit 114.

  In addition, the karaoke system 10 includes a display unit 115, a display control unit 116 for controlling the display unit 115, a short distance wireless communication unit 117 for performing short distance wireless communication with a remote control device or communication terminal device 20 not shown, A system control unit 118 that controls in an integrated manner, a system DB 119 stored in association with a part of karaoke data and rendering effect data, a data processing unit 120 that performs output control of rendering effect data, and a user's instruction The operation unit 130, the timer 140, and the ROM / RAM 150 are provided.

  The karaoke system 10 is connected to the system control unit 118 by a bus B and a predetermined transmission line.

  The communication control unit 111 is a communication terminal apparatus (a communication terminal apparatus registered as a controller as described later) 20 or a communication line with the management server apparatus 30 under the control of the system control unit 118 and held by the user via the network N. To exchange various data.

  In particular, the communication control unit 111 receives an operation instruction such as a music selection instruction including a music selection number by the user from the communication terminal device 20 via the short distance wireless communication unit 117 or the network N or from a remote control device (not shown).

Then, when the communication control unit 111 receives the music selection instruction, under the control of the system control unit 118,
(1) Based on the music selection number, acquire karaoke data from the management server device 30, or read out from the system DB 119,
(2) The acquired or read karaoke data is supplied to the karaoke reproduction unit 113 at a predetermined reproduction timing,
(3) The lyrics are output to the display unit 115 together with the background image while being synchronized with the output of the musical tone related to the music data.

  Note that, when the music selection instruction is received, the communication control unit 111 acquires the acquired karaoke data until the reproduction timing, when another selected karaoke data is already set (that is, in the case of the music selection reservation). It is stored in the ROM / RAM 150.

  On the other hand, when the communication control unit 111 receives an output instruction of the selected effect data from the remote control device 11 during reproduction of the karaoke data, the communication control unit 111 provides the received output instruction to the data processing unit 120.

  The karaoke reproduction unit 113 has a MIDI sound source, and is included in karaoke data acquired (downloaded) from the storage device 40 via the management server device 30 or read out from the system DB 119 under the control of the system control unit 118. A reproduction process is performed to control the MIDI sound source based on the music data.

  Then, the karaoke reproduction unit 113 outputs the musical tone data generated by the reproduction processing to the loud sound processing unit 114.

  In addition, the karaoke reproduction unit 113 is a case where the output control instruction of the selected rendering effect data acquired through the remote control device 11 is acquired under the control of the system control unit 118, and the selected rendering effect data is the sound effect data In this case, sound effect data of the selected effect data specified based on the output control instruction is output to the loud sound processing unit 114.

  On the other hand, the karaoke reproducing unit 113 extracts genre data included in the karaoke data, and acquires background image data stored in association with the genre data from the system DB 119.

  Then, the karaoke reproduction unit 113 outputs, to the display control unit 116, an image signal for displaying the background image based on the acquired background image data on the display unit 115 in synchronization with the output of the musical tone.

  In the present embodiment, the background image data may be acquired from the communication terminal apparatus 20 owned by the user, or may be acquired from an external web page via the network N. Also, in this case, the karaoke reproduction unit 113 causes the display unit 115 to display a background image based on the acquired background image data in synchronization with the reproduction of the music data.

  Under the control of the system control unit 118, the loudspeaker processing unit 114 converts the musical tone data output from the karaoke reproduction unit 113 into an analog audio signal, amplifies the converted audio signal to a predetermined level, and outputs the speaker Perform processing to output to SP.

  In addition, speaker SP is comprised by the system suitable according to the installation place in which the karaoke system 10 was provided. Further, various types of signal processing such as reverberation processing may be performed in the loud sound processing unit 114, and an audio signal after the signal processing may be output from the speaker SP.

  The display unit 115 is formed of, for example, an organic EL (Electro-Luminescence) element or a liquid crystal display element, and displays a predetermined image according to the control of the display control unit 116.

  Specifically, the display unit 115 displays an image on which the lyrics are superimposed based on the background image data and the lyrics data. That is, the display unit 115 performs karaoke display displaying lyrics and a background image together with the music data to be reproduced.

  In addition, in the case where the display unit 115 acquires an output control instruction of the selected rendering effect data acquired through the remote control device 11 and the selected rendering effect data is the effect image data, the display control instruction is The effect image is displayed on the background image based on the rendering effect data specified based on the above.

  The display control unit 116 executes display processing based on background image data under the control of the system control unit 118, generates display data for displaying a background image, and outputs the display data to the display unit 115.

  In addition, the display control unit 116 is a case where the output control instruction of the selected rendering effect data acquired through the remote control device 11 is acquired under the control of the system control unit 118, and the selected rendering effect data is the effect image data In this case, display data in which the effect image is superimposed on the background image is generated based on the effect image data of the selected effect data specified based on the output control instruction, and is output to the display unit 115.

  The short distance wireless communication unit 117 exchanges data with the remote control device 11 in accordance with infrared communication such as IrDA (Infrared data Association) or a short distance wireless communication standard such as bluetooth, IEEE 802.15.4, or wireless LAN.

  For example, the short distance wireless communication unit 117 receives a user's instruction input using the remote control device 11, and outputs a command corresponding to the received instruction to the system control unit 180 or the data processing unit 120 via the bus B. .

  Communication between the remote control device 11 and the karaoke system 10 may be performed via the network N or the management server device 30.

  On the other hand, the short distance wireless communication unit 117 transmits the reproduction information generated by the data processing unit 120 to the remote control device 11 during reproduction of the karaoke data.

  A system control unit 118 mainly includes a central processing unit (CPU) (not shown), a cache memory, and a RAM, and integrally controls the respective units. Further, the system control unit 118 executes processing for realizing the respective functions while interlocking with each unit.

The system DB 119
(1) A program used when executing processing for realizing each function,
(2) A plurality of background image data having genre data and to be displayed on the display unit 115 when playing back music data;
(3) With karaoke data,
(4) Production effect data,
Is stored.

In particular, as shown in FIG.
(1) Production effect ID,
(2) Classification information of constituent parts constituting selectable music pieces and attribute information of constituent part attributes indicating tunes,
(3) music attributes,
(4) Body data of sound effect data,
(5) Body data of one or more effect image data,
Are stored in association with each other.

  The data processing unit 120 includes a CPU and a ROM / RAM 122 as a work area, which are the same as or independent from the system control unit 118, and executes an application.

  Then, the data processing unit 120 is transmitted from the remote control device 11 by the reproduction information generation processing unit 121 which generates reproduction information using various data of karaoke data during reproduction of karaoke data by executing an application. And an effect data output control unit 122 configured to control the output of the effect data based on the output instruction of the selected effect data.

  When the reproduction information generation processing unit 121 receives an instruction to start using the effect image from the remote control device 11 during reproduction of the karaoke data, a predetermined time interval (for example, after one second) until the reproduction of the karaoke data ends. Every time, various information is acquired from the karaoke data being reproduced.

  Then, the reproduction information generation processing unit 121 generates transmission data (hereinafter referred to as “transmission data for reproduction information”) including the reproduction information at predetermined time intervals, and the remote control device via the short distance wireless communication unit 117 Send to 11

  When the reproduction information generation processing unit 121 receives an instruction to change the reproduction length of karaoke data, such as an instruction to change the tempo during reproduction of karaoke data, the reproduction information generation processing unit 121 changes the reception timing. Execute generation and transmission of reproduction information transmission data in consideration of reproduction length.

Specifically, during reproduction of karaoke data, the reproduction information generation processing unit 121
(A) music information, and (B) playback status information,
To generate playback information including

In particular, as illustrated in FIG.
(A1) genre information of the music being played;
(A2) song tone information indicating the overall tone of the song being played;
Attribute (hereinafter referred to as "music attribute") is included.

Also, as illustrated in FIG.
(B1) Information on reproduction timing during reproduction indicating the reproduction time from the beginning of the music (hereinafter referred to as "reproduction timing information"),
(B2) Classification type of composition part on composition of current music in music being reproduced such as A melody and rust as one of composition part information
(B3) The tune of the current component part in the music being played as one of the component part information,
(B4) For example, information of reproduction end timing based on the tempo currently set in the music being reproduced with an elapsed time from the beginning of the music (hereinafter referred to as "reproduction end timing information"), and
(B5) Music structure information indicating all the component parts arranged in the performance order from the performance start to the performance end of the music being reproduced and information on the end timing of each component part (hereinafter referred to as "configuration part end timing information") ,
It is included.

  The music information is defined, for example, in the header of the reproduction information, and the reproduction status information is defined in the body portion of the reproduction information. In addition, the tune of the composition part included in the reproduction status information may be a tune that changes even in the music depending on the medley or the type of the tune, and the tune is information defining the change.

Also, for example, in FIG.
(1) Genre information "POP",
(2) Song information "bright"
(3) Reproduction timing information "after one minute and one second",
(4) Classification type "B Melo" of component parts
(5) The tune "bright" of the configuration part
(6) Reproduction end timing "4 minutes 20 seconds"
(7) Configuration part end timing information "A melody: 30 seconds from the start of performance / B melody: 59 seconds from start of performance / Sabi: 1 minute and 20 seconds from start of performance / interplay: 1 minute and 30 seconds from start of performance: A melody: 2 minutes and 0 seconds from the beginning of the performance ... "
Reproduction information in which each piece of information is defined is shown.

  When the effect data output control unit 122 receives an instruction to output selected rendering effect data from the remote control device 11 during reproduction of karaoke data via the communication control unit 111, it extracts a rendering effect ID included in the output instruction. Do.

  Then, the effect data output control unit 122 searches the system DB 119 based on the extracted effect effect ID, reads out the corresponding sound effect data from the system DB 119, and outputs it to the karaoke reproduction unit 113, and the corresponding effect image Data is read from the system DB 119 and output to the display control unit 116

[3] Communication Terminal Device Next, the configuration and operation of the communication terminal device 20 of the present embodiment will be described using FIGS. 6 and 7. 6 is a block diagram showing the configuration of the communication terminal apparatus 20 in the present embodiment, and FIG. 7 is an example of table data stored in the data storage unit 262.

  As shown in FIG. 6, the remote control device 20 according to the present embodiment includes a network communication unit 210 communicatively connected to the network N, a short distance wireless communication unit 220 performing short distance wireless communication with the karaoke system 10, and a display unit 240. A display control unit 250 that controls display of an image on the display unit 240, a storage unit 260 that stores data corresponding to various information, an operation unit 270 configured of a touch panel, a remote control control unit 280, The timer 201 is included.

  And remote control device 20 has application execution part 290 which performs each processing for making it function as a remote control device of karaoke system 10 including output control of performance effect data selected by a user during reproduction of Karao data. ing.

  The respective units of remote control device 20 are mutually connected by a bus B, and execute exchange of data.

  The network communication unit 210 is a predetermined network interface, and under the control of the remote control control unit 280 and the application execution unit 290, the karaoke system 10 or the management server device 30 and the communication line are connected to the network N via the base station BS. And exchange various data with the karaoke system 10 or the management server device 30.

  The short distance wireless communication unit 220 exchanges data with the karaoke system 10 in accordance with infrared communication such as IrDA (Infrared data Association) or a short distance wireless communication standard such as bluetooth, IEEE 802.15.4, or wireless LAN.

  The display unit 240 has an image display area of a predetermined size (for example, 5 inches, W 480 × H 960 pixels), is constituted by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 250 A predetermined image is displayed based on the display data.

  In particular, in the present embodiment, the display unit 240 displays an image for selecting presentation effect data to the user when executing the presentation effect data selection control process under the control of the display control unit 250.

  The display control unit 250 generates drawing data necessary for causing the display unit 240 to draw a predetermined image under the control of the remote control control unit 280 and the application execution unit 290, and the generated drawing data is displayed on the display unit 240. Output.

  The storage unit 260 is configured by, for example, an EEPROM (Electrically Erasable Programmable Read Only Memory), a flash memory, or the like.

  Then, the storage unit 260 includes an application storage unit 261 for storing various applications, a data storage unit 262 for storing table data used when performing rendering effect data selection control processing, and a work during activation of the operation application. And a RAM 264 functioning as an area.

In particular, as table data stored in the data storage unit 262, for example, as shown in FIG.
(1) Production effect ID,
(2) Classification information of constituent parts constituting selectable music pieces and attribute information of constituent part attributes indicating tunes,
(3) music attributes,
(4) Text data that characterizes sound effects,
(5) Data of thumbnail images in the effect image (hereinafter referred to as "thumbnail image data"),
Are stored in association with each other.

  The various applications include a touch panel operation application (hereinafter referred to as "operation application") for operating the karaoke system 10 including music selection operation and rendering effect data selection control processing.

  The operation unit 270 is composed of a touch panel having various confirmation buttons, operation buttons and other keys for inputting each operation command, and a touch sensor provided on the display unit 240, and includes a karaoke system including selection of effect data It is used when performing each operation of 10.

  The remote control control unit 280 mainly includes a central processing unit (CPU), and includes various input / output ports such as a key input port and a display control port, and the general function and information providing program of the communication terminal device 20. Control the overall functions to implement

  The application execution unit 290 is configured by an independent central processing unit (CPU), or is configured using a central processing unit (CPU) of the remote control unit 280.

  Then, the application execution unit 290 realizes an operation control unit 291 that executes a function as a remote control device by executing an operation application, and a rendering effect control processing unit 292 that performs rendering effect data selection control processing.

  In addition, for example, the operation control unit 291 of the present embodiment constitutes a receiving unit of the present invention. Also, for example, the rendering effect control processing unit 292 of the present embodiment constitutes the specifying unit of the present invention, and constitutes the managing unit of the present invention that manages the data storage unit 263 as the storage unit of the present invention. Then, for example, the rendering effect control processing unit 292 of the present embodiment configures the receiving unit of the present invention together with the short-distance wireless communication unit 220 and the transmitting unit of the present invention together with the network communication unit 210.

  The operation control unit 291 operates in conjunction with the display control unit 250 and the operation unit 270 under the control of the remote control unit 280, and receives various operations of the karaoke system 10 based on the user's operation by executing the operation application. It transmits to the karaoke system 10 via the network communication unit 210 or the near field communication unit 220.

  When the remote control device 11 is realized by a communication terminal device such as a smartphone, the operation control unit 291 operates in conjunction with the karaoke system 10 and uses the usage registration process for setting the remote control device of the corresponding karaoke system 10. Run.

  The effect effect control processing unit 292 specifies effect effect data based on the reproduction information received during reproduction of the karaoke data, and selects effect effect data for controlling the karaoke system 10 to output and control the selected effect effect data. Execute control processing.

  The details of the rendering effect control processing unit 292 in the present embodiment will be described later.

  The timer 201 is used by the application execution unit 200 to perform counting necessary for rendering effect data selection control processing.

[4] Rendering Effect Control Processing Unit Next, the rendering effect control processing unit according to the present embodiment will be described in detail with reference to FIG. FIG. 8 is an example of a selection screen when selecting rendering effect data to be displayed on the display unit 240.

  When the effect effect control processing unit 292 detects the use start instruction of the effect effect input through the operation unit 270 when starting to use the effect effect image, the operation control unit 291 causes the operation control unit 291 via the network communication unit 210. An instruction to start using the rendering effect is sent to the karaoke system 10 via the management server device 30.

  The operation control unit 291 may transmit the usage start instruction of the rendering effect to the close proximity wireless communication unit 220 directly to the karaoke system 10.

  Then, when the rendering effect control processing unit 292 receives the reproduction information transmitted from the karaoke system 10 within a certain period (for example, within one minute) after transmitting the usage start instruction of the rendering effect, the rendering effect control process If the reproduction information is not received within the predetermined period (for example, within one minute), normal selection processing (that is, selection processing effect data is selected by the user's instruction using the operation control unit 291) , And perform normal selection processing of effect data).

  In addition, since the selection process of a normal presentation effect data is the same as the conventional method, the description is abbreviate | omitted.

  On the other hand, when the rendering effect control processing unit 292 receives the reproduction information within a predetermined period after transmitting the usage start instruction of the rendering effect, the rendering effect control processing unit 292 extracts the music information and the reproduction status information from the received reproduction information.

  Then, based on the extracted music information and the reproduction state, the effect effect control processing unit 292 sets a predetermined condition (from among the effect effect data (that is, available effect effect data) stored in the karaoke system 10) Hereinafter, the rendering effect data including the “specific condition” is specified as the selectable rendering data that can be selected by the user.

  Specifically, based on the reproduction timing information and the reproduction end timing information of the extracted reproduction status information, the effect effect control processing unit 292 performs the reproduction timing within a predetermined period before the music reproduction end timing (e.g. In the case of 15 seconds or less), among the available rendering effect data, there is a category type of end of reproduction as a category type of component parts, and an effect meeting the specific condition based on other reproduction information The effect data (that is, data that can be selected and presented) is specified.

  Further, the effect effect control processing unit 292 can use available effects when the reproduction timing is not within the predetermined period before the music reproduction end timing and when the reproduction timing is not within the predetermined period before the configuration part reproduction end timing. From the effect data, the category type of the current configuration part is included as the category type of the configuration part, and, based on the other reproduction information, the selection effectable data meeting the specific condition is specified.

  Furthermore, the effect effect control processing unit 292 is in the case where the playback timing is not within the fixed period before the music playback end timing, and the playback timing is within the fixed period until the current configuration part finish timing (for example 5 In the case where it is within seconds), the category type of the next configuration part in the music structure information as the category type of the configuration part out of the available rendering effect data, and based on the other reproduction information And selectable effect enabling data that matches the specific condition.

  Note that “genre information” and “musical tune” or “musical part of the composition part” if it is specified as the selection effectable data that matches the specific condition based on the reproduction information other than the classification type of the composition part The corresponding presentation effect data is included.

  On the other hand, the effect effect control processing unit 292 displays a selection image for causing the display unit 240 to select the specified selection enabling data, and stands by for an instruction input of selection operation by the user.

  Specifically, the effect effect control processing unit 292 displays, on the display unit 240, a thumbnail image or a character string for causing the user to image the selectable effect enable data, as a selected image. For example, as shown in FIG. 8, the effect effect control processing unit 292 categorizes the character strings of the same sound effects, and displays, for each of the sound effects, a thumbnail image for causing the user to image selection possible data. Displayed on 240.

  Then, when the rendering effect control processing unit 292 detects an instruction input of the selection operation of the user via the operation unit 270, the rendering effect of the rendering effect data selected via the short distance wireless communication unit 117 is the rendering effect A presentation effect image ID of data is added and transmitted to the karaoke system 10.

[5] Rendering Effect Data Selection Control Processing Next, rendering effect data selection control processing executed in the remote control device 20 of the present embodiment will be described using FIGS. 9 and 10. 9 and 10 are flowcharts showing operations of rendering effect data selection control processing executed in the remote control device 20 of the present embodiment.

  In this operation, it is assumed that the remote control device 20 has already been registered as a control unit of the karaoke system 10 and the karaoke system 10 is used by the user.

  In this operation, it is assumed that the rendering effect data shown in FIG. 4 and the table data shown in FIG. 7 are already stored in the karaoke system 10 or the remote control device 20, respectively.

  First, when the operation control unit 291 detects a use start instruction of a rendering effect input through the operation unit 270 (step S101), the management server device performs a use start instruction of the rendering effect via the network communication unit 210. It transmits to the karaoke system 10 via 30 (step S102).

  The operation control unit 291 may directly transmit the usage start instruction of the rendering effect to the karaoke system 10 via the proximity wireless communication unit 220.

  Next, the effect effect control processing unit 292 determines whether or not the reproduction information transmitted from the karaoke system 10 has been received within a certain period (for example, within one minute) after the transmission start instruction of the effect effect has been transmitted (step S103).

  At this time, if it is determined that the reproduction information has not been received within a certain period after the transmission of the usage start instruction of the rendering effect, the rendering effect control processing unit 292 selects normal rendering effect data (step S104). To end this operation.

  In addition, when it is determined that the reproduction information has been received within a certain period after the transmission of the usage start instruction of the effect, the effect effect control processing unit 292 extracts the music information and the reproduction status information from the received reproduction information ( Step S105).

  Then, based on the reproduction timing information and the reproduction end timing information of the extracted reproduction status information, the effect effect control processing unit 292 performs the reproduction timing within a predetermined period before the music reproduction end timing (for example, within 15 seconds until the music reproduction ends). It is determined whether or not (step S106).

  At this time, when the effect control process unit 292 determines that the reproduction timing is within a predetermined period before the music reproduction end timing, the reproduction end is classified as the classification type of the component part out of the available effect effect data. The selection effectable data having the classification type of and matching the specific condition is specified based on other reproduction information (step S107), and the process proceeds to step S111.

  On the other hand, when the effect control process unit 292 determines that the reproduction timing is not within the predetermined period before the music reproduction end timing, the reproduction timing is within the predetermined period until the current configuration part end timing (for example, the reproduction end of the configuration part It is determined whether or not it is within 5 seconds) (step S108).

  Then, when the effect effect control processing unit 292 determines that the reproduction timing is within a predetermined period before the constituent part reproduction end timing, the music structure as the classification type of the constituent part among the available effect effect data. Of the information, it has a category type of the next configuration part (hereinafter referred to as "next configuration part"), and identifies the selectable presentation enable data that matches the specific condition based on other reproduction information (step S109), the process proceeds to step S111.

  On the other hand, when the effect effect control processing unit 292 determines that the reproduction timing is not within the fixed period before the component part reproduction end timing, the present configuration as the classification type of the component part among the available effect effect data. The process of step S111 is performed by specifying the selectable effect enableable data having the classification type of the part (hereinafter referred to as “the current configuration part”) and meeting the specific condition based on the other reproduction information (step S110) Migrate to

  Next, the effect effect control processing unit 292 displays a selected image indicated by the selected effectable data specified on the display unit 240, and stands by for an instruction input of selection operation by the user (step S111).

  Next, the effect effect control processing unit 292 determines whether or not the selection of one of the selectable effectable data is detected by the user's instruction input via the operation unit 207 within a fixed period (for example, within 5 seconds) (step S112).

  At this time, when the effect control processing unit 292 determines that the user's instruction input is not detected within a predetermined period, the display of the selected image is canceled and the reception of the next reproduction information is waited (step S113). And the process of step S115.

  In addition, when the effect effect control processing unit 292 determines that the user's instruction input has been detected within a certain period, the karaoke system 10 instructs to output the effect effect data selected via the short distance wireless communication unit 117. , And waits for the next reproduction information to be received (step S114), and the process proceeds to step S115.

  Next, the effect effect control processing unit 292 determines whether or not the reproduction information transmitted from the karaoke system 10 has been received within a fixed period (for example, within one minute) after the reception standby (step S115).

  At this time, when it is determined that the reproduction information has been received within a predetermined period after reception standby, the effect effect control processing unit 292 proceeds to the process of step S105, and receives the reproduction information within the predetermined period after reception standby. If it is determined not, the operation is ended.

  As described above, the karaoke communication system 1 according to the present embodiment automatically specifies data suitable for use from among a plurality of sound effects and effect image effect data based on the reproduction status during reproduction of karaoke data. Since it can be presented to the user in a selectable manner, it is possible to allow the user to select an appropriate sound effect or effect image that enhances the atmosphere of the place, and it is possible to easily select and improve the convenience of the user.

  In particular, the karaoke communication system 1 of the present embodiment can allow the user to select rendering effect data appropriately and easily, even if many rendering effect data can be provided.

[6] Modification [6.1] Modification 1
In the above embodiment, the rendering effect data selection process is executed using the reproduction information transmitted from the karaoke system 10. However, the musical sound output from the karaoke system 10 is collected, and the collected musical sound is collected. The rendering effect data selection process may be executed based on

In this case, remote control device 20
(1) A presentation effect ID for identifying presentation effect data of at least one of data for outputting a sound effect and data for displaying an effect image, and attribute information indicating a configuration part attribute indicating an attribute of a configuration part constituting a music And the data storage unit 162 stored in association with each other,
(2) An analysis result obtained by executing a predetermined analysis on the musical tone of the music being reproduced is associated with the component part, acquired from the management server device 30 in advance and stored in the RAM 263 before reproduction
(3) While playing the music, collect the musical tones output from the karaoke system 10,
(4) The collected tones are analyzed to execute the predetermined analysis, and based on the analysis result, the reproduction point is recognized, and the component part to which the recognized reproduction point belongs is specified.
(5) From the stored effect data, specify the effect data having an attribute that matches or is related to the specified configuration part as selectable data that can be selected by the user,
(6) When a user's instruction input for selecting predetermined rendering effect data as selection data from among the specified selectable data is received,
(7) Send an instruction to output the received selected data to the karaoke system 10,
It has a configuration.

  That is, in this case, the remote control device 11 acquires in advance the reproduction music information and reproduction state information (except reproduction timing information) in the karaoke data being reproduced, stores it in the RAM 263, and stores the musical tone of the karaoke data being reproduced. The results of the frequency analysis of (e.g., frequency components after Fourier transform) are stored in the RAM 263.

Further, remote control device 20 collects musical tones output from karaoke system 10 during reproduction of karaoke data, executes frequency analysis thereof, and collates the result with the analysis result stored in RAM 263. To recognize the current playback point in the karaoke data.
Then, the remote control device 20 specifies the component part to which the reproduction point belongs based on the recognized reproduction point, and executes rendering effect data selection processing based on the specified component part in the same manner as described above.

[6.2] Modification 2
In the above-mentioned embodiment, although karaoke system 10 based on a singer's song sound was explained, it is also possible to apply to karaoke system 10 or karaoke communication system 1 based on musical instrument sounds, such as a guitar and a drum. In this case, the karaoke system 10 may acquire an instrument sound or an instrument signal by the microphone M or another input device.

[6.3] Modification 3
In the above embodiment, the input instruction of the user operation is detected by the operation unit 270 of the remote control device 20, but may be detected by the operation unit 130 of the karaoke system 10.

  Moreover, in the said embodiment, although rendering effect data selection control processing is performed in the remote control apparatus 20, the one part may be performed by the management server apparatus 30 or the karaoke system 10. FIG. For example, the management server device 30 receives the detection of the instruction input of the user operation through the communication line, and the function of the effect control processing unit 292 performs the processing of the presentation effect data selection control process based on the received instruction input. You may have.

[6.4] Modification 4
The management server device 30 in the above embodiment may be configured of one server device, or may be configured as a system of a plurality of server devices.

1 ... karaoke communication system 10 ... karaoke system 20 ... communication terminal device 30 ... management server device 40 ... storage device 401 ... user management DB
402 ... DB for karaoke data
111 ... communication control unit 112 ... voice input / output unit 113 ... karaoke reproduction unit 114 ... voice amplification unit 115 ... display unit 116 ... display control unit 117 ... short distance wireless communication unit 118 ... system control unit 119 ... system DB
111 ... communication control unit 120 ... data processing unit 123 ... reservation control unit 124 ... language setting unit 125 ... usage registration unit 130 ... operation unit 140 ... timer 150 ... ROM / RAM
201 ... timer 210 ... network communication unit 220 ... near field communication unit 240 ... display unit 250 ... display control unit 260 ... recording unit 261 ... application recording unit 262 ... data recording unit 263 ... RAM
270 ... operation unit 280 ... remote control control unit 290 ... application execution unit 291 ... operation control unit 292 ... effect effect control processing unit

Claims (10)

It is an operation control device for operating a karaoke system that executes reproduction of music,
Component effect information indicating at least one of rendering effect data of data for outputting a sound effect and data for displaying an effect image, identification information for identifying the rendering effect data, and an attribute of a configuration part constituting the music And storage means associated with each other and stored,
Receiving means for receiving reproduction information including component part attribute information indicating attributes of component parts of the music transmitted from the karaoke system during reproduction of the music;
The user can select, from among the plurality of effect data stored in the storage means, the effect data having an attribute that matches or is related to the component part attribute included in the received reproduction information. Specifying means for specifying as selectable data,
Reception means for receiving an instruction input of the user for selecting predetermined rendering effect data as selection data from among the specified selectable data;
Transmission means for associating the output instruction of the received selection data with identification information of the effect data, and transmitting it to the karaoke system in which the effect data is stored;
An operation control apparatus comprising: In the operation control device according to claim 1,
The reproduction information includes a music attribute indicating an attribute of the music,
The identification means
Among the plurality of effect effect data stored in the storage means, it has an attribute that matches or is related to the component part attribute included in the received reproduction information, and is included in the reproduction information The operation control apparatus, wherein the effect data having the music attribute that matches the music attribute is specified as the selectable data. In the operation control device according to claim 1 or 2,
The operation control apparatus, wherein the configuration part attribute includes at least one of a category type indicating a category of the configuration part and a tune of the configuration part. The operation control device according to any one of claims 1 to 3.
The reproduction information further includes timing information indicating reproduction timing of music and part end time information indicating reproduction end time of the component part.
The identification means
The reproduction timing of the music is recognized based on the timing information,
According to the recognized reproduction timing and the reproduction end time included in the part end time information, and based on the configuration part attribute, among a plurality of the rendering effect data stored in the storage unit An operation control device for identifying the selectable data. In the operation control device according to claim 4,
The reproduction information further includes music structure information indicating a structure in a component part of the music being reproduced,
The identification means
The music structure information and the constituent part attribute included in the received reproduction information when the recognized reproduction timing satisfies a predetermined condition with respect to the reproduction end time included in the part end time information Recognize the next component part of the component part of the music being reproduced, and match the recognized next component part attribute from among the plurality of effect data stored in the storage means Identifying rendering effect data having configuration part attributes to be selected as the selectable data,
When the predetermined condition is not satisfied, among the plurality of effect data stored in the storage unit, effect effect data having attribute information that matches the component part attribute is specified as the selectable data. Operation control device. In the operation control device according to any one of claims 1 to 4,
The reproduction information includes timing information indicating a reproduction timing of the music and music end time information indicating a reproduction end time of the music,
The identification means
The reproduction timing of the music is recognized based on the timing information,
When a predetermined condition is satisfied with respect to the reproduction end time included in the music end time information, the reproduction time of the recognized music can be specified based on the component part attribute information included in the reproduction information. The operation control apparatus according to claim 1, further comprising: specifying, in the selectable data, presentation effect data preset as presentation effect data to be used when the reproduction of the music ends instead of the presentation effect data. In the operation control device according to any one of claims 1 to 4,
The receiving means
It is determined that the reproduction information is not received even when a predetermined time has passed after the output request is received, when the output request for the effect effect data is received by the user via the reception means. In this case, the operation control device that specifies, as the selectable data, presentation effect data that is preset as presentation effect data to be used when reception is not possible. It is an operation control device for operating a karaoke system that executes reproduction of music,
Component effect information indicating at least one of rendering effect data of data for outputting a sound effect and data for displaying an effect image, identification information for identifying the rendering effect data, and an attribute of a configuration part constituting the music And storage means associated with each other and stored,
An acquiring unit that associates an analysis result obtained by executing a predetermined analysis on the musical tone of the music with a component part and acquires it in advance before reproduction;
Sound collecting means for collecting the musical tones output from the karaoke system during reproduction of the music;
Recognition specifying means for performing the predetermined analysis on the collected musical tones, recognizing a reproduction point based on the analysis result, and identifying the component part to which the recognized reproduction point belongs;
Among the plurality of the rendering effect data stored in the storage means, the rendering effect data having an attribute that matches or is associated with the specified configuration part is specified as selectable data that can be selected by the user Specific means to
Reception means for receiving an instruction input of the user for selecting predetermined rendering effect data as selection data from among the specified selectable data;
Transmission means for associating the output instruction of the received selection data with identification information of the effect data, and transmitting it to the karaoke system in which the effect data is stored;
An operation control apparatus comprising: A program for executing a computer of an operation control device for operating a karaoke system for reproducing music,
The computer,
Component effect information indicating at least one of rendering effect data of data for outputting a sound effect and data for displaying an effect image, identification information for identifying the rendering effect data, and an attribute of a configuration part constituting the music And storage means associated with each other and stored,
Receiving means for receiving reproduction information including component part attribute information indicating attributes of component parts of the music transmitted from the karaoke system during reproduction of the music;
The user can select, from among the plurality of effect data stored in the storage means, the effect data having an attribute that matches or is related to the component part attribute included in the received reproduction information. Specifying means for specifying as selectable data,
Reception means for receiving an instruction input of the user for selecting predetermined rendering effect data as selection data from among the specified selectable data;
Transmission means for associating the output instruction of the received selection data with identification information of the effect data, and transmitting it to the karaoke system in which the effect data is stored;
A program characterized by making it function. A program for executing a computer of an operation control device for operating a karaoke system for reproducing music,
The computer,
Component effect information indicating at least one of effect effect data of data for outputting a sound effect and data for displaying an effect image, identification information for identifying the performance effect data, and attributes of component parts constituting the music And storage means associated with each other, and
An acquiring unit that associates an analysis result obtained by executing a predetermined analysis on the musical tone of the music with a component part and acquires it in advance before reproduction;
Sound collecting means for collecting the musical tones output from the karaoke system during reproduction of the music;
Recognition specifying means for performing the predetermined analysis on the collected tones and recognizing a reproduction point based on the analysis result, and identifying the component part to which the recognized reproduction point belongs;
Among the plurality of the rendering effect data stored in the storage means, the rendering effect data having an attribute that matches or is associated with the specified configuration part is specified as selectable data that can be selected by the user Specific means to
Reception means for receiving an instruction input of the user for selecting predetermined rendering effect data as selection data from among the specified selectable data;
A transmitting unit that transmits the received output instruction of the selection data to the karaoke system in which rendering effect data is stored, in association with identification information of the rendering effect data;
A program characterized by acting as