WO2015113360A1 - System and method for learning,composing,and playing music with physical objects - Google Patents

System and method for learning,composing,and playing music with physical objects Download PDF

Info

Publication number
WO2015113360A1
WO2015113360A1 PCT/CN2014/080317 CN2014080317W WO2015113360A1 WO 2015113360 A1 WO2015113360 A1 WO 2015113360A1 CN 2014080317 W CN2014080317 W CN 2014080317W WO 2015113360 A1 WO2015113360 A1 WO 2015113360A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
interactive surface
symbol
identifier
cards
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/080317
Other languages
French (fr)
Inventor
Zheng Shi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/CN2014/071850 external-priority patent/WO2014139349A1/en
Application filed by Individual filed Critical Individual
Priority to KR1020167020173A priority Critical patent/KR20160104644A/en
Priority to CN201480043673.3A priority patent/CN105453168A/en
Priority to JP2016548114A priority patent/JP6429336B2/en
Priority to EP14880685.4A priority patent/EP3100257A4/en
Priority to PCT/CN2014/081721 priority patent/WO2015113376A1/en
Priority to EP14880674.8A priority patent/EP3100147A4/en
Priority to CN201480041861.2A priority patent/CN105765512A/en
Priority to JP2016548134A priority patent/JP6326143B2/en
Priority to PCT/CN2014/082483 priority patent/WO2015113381A1/en
Priority to US14/489,199 priority patent/US9183755B2/en
Priority to PCT/CN2014/091143 priority patent/WO2015113433A1/en
Priority to CN201480073599.XA priority patent/CN105917293B/en
Priority to US14/561,959 priority patent/US9268535B2/en
Priority to PCT/CN2015/070162 priority patent/WO2015113457A1/en
Priority to KR1020167020190A priority patent/KR101813557B1/en
Priority to CN201580000167.0A priority patent/CN105027192B/en
Priority to EP15743177.6A priority patent/EP3100258A4/en
Priority to JP2016548113A priority patent/JP2017507349A/en
Priority to US14/737,514 priority patent/US9299330B2/en
Publication of WO2015113360A1 publication Critical patent/WO2015113360A1/en
Priority to US14/830,757 priority patent/US20160180734A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B1/00Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways
    • G09B1/02Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways and having a support carrying or adapted to carry the elements
    • G09B1/04Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways and having a support carrying or adapted to carry the elements the elements each bearing a single symbol or a single combination of symbols
    • G09B1/06Manually or mechanically operated educational appliances using elements forming, or bearing, symbols, signs, pictures, or the like which are arranged or adapted to be arranged in one or more particular ways and having a support carrying or adapted to carry the elements the elements each bearing a single symbol or a single combination of symbols and being attachable to, or mounted on, the support
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55Controlling game characters or game objects based on the game progress
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005Input arrangements through a video camera
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/34Graphical or visual programming
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033Indexing scheme relating to G06F3/033
    • G06F2203/0337Status LEDs integrated in the mouse to provide visual feedback to the user about the status of the input device, the PC, or the user

Definitions

  • the present invention and its embodiments relates to the field of music application on electronic devices, and more particularly, an interactive surface using cards to compose and play music.
  • Music is the one of the most beautiful creations of the human race. Music is expressed in complex forms, syntaxes, colors and articulations that are rooted both in the human biology and elegant mathematics.
  • the present invention discloses a system and method for learning, composing, accessing and playing music.
  • the system comprises: a plurality of objects configured to be placed next to or on top of each other to form a structural pattern, each object comprises an identifier and assigned a music -related indicator; an interactive surface configured to recognize the identifier and location information of an object placed on the interactive surface; a processor operatively linked to the interactive surface; a memory operatively linked to the processor and configured to store a database of correlation relationship between identifier and music-related indicator; and an acoustic or visual device so as to supply real-time feedback to the user.
  • the processor is configured to derive a music piece from the structural pattern.
  • a music -related indicator is derived from a music symbol, an Arabic numeral, a color, an icon, a figure, or a figurine that can be interpreted as a symbol of music syntax.
  • a music symbol may be one of the followings: a single music note with pitch and duration; a single chord with the music note being the root; a rest and the duration of rest; accidentals that alter the pitch of a music note; dots or ties that modify the duration of a music note; major chords, minor chords, triad chords or seventh chords; key signatures that define the music piece being a major scale or a minor scale; raising or lowering the pitch of a music note in the same pitch class; symbols that define the texture, timbre, dynamics and articulation of the music piece, including those that are commonly used and those custom designed to enhance the music for a particular audience, sentiment and purpose.
  • a music-related indicator can also be a symbol chosen among a plurality of programming functions, including: start, end, repeat, condition, and jump that organize indicators into a structural pattern to be translated into a music piece by the processor; toggle, that, when used together with a music symbol, allows each of the variations of the symbol to be presented and chosen; equal and assign, that enable one object to be assigned to represent a first structural pattern, with the resulting object capable of being incorporated into a second structural pattern; record, retrieve, save, cancel, delete, group, ungroup, connect, disconnect, combine, and separate, that manage a music piece as an electronic file, and enable the synthesis of a larger music piece from a plurality of music pieces.
  • a music -related indicator can also be a symbol that represents musical instruments, including percussion, wind and string instruments, and a symbol that represents human voices and sounds from nature.
  • an identifier of an object is defined by a unique optical pattern of the object.
  • the unique optical pattern can be a marking of music notation, a marking of linguistic or mathematical notation, a marking of icons or graphics, or a unique pattern of 2D or 3D shape, color and texture visible or invisible to the human eye.
  • identifiers are either pre-fabricated on the object, or marked on the object by a user with such marking being either permanent or erasable.
  • a camera affixed or otherwise operatively linked to the processor can recognize the unique optical pattern, and transmit that information to the processor.
  • the processor further accesses a database of correlation relationship between identifiers and music-related indicators stored in memory, and matches a music-related indicator for each identifier that the processor has recognized.
  • the processor further deduces the music piece from the structural pattern formed by a plurality of objects, based on the music -related indicators that are associated with the identifiers and the locations of each of the objects in the structural pattern.
  • an identifier of an object can also be defined by a unique identification code (UID) that is embedded in the object.
  • UID unique identification code
  • the UID can be encoded with a radio frequency identification chip, a unique pattern of capacitive tabs, or a unique pattern of magnetic tabs.
  • the interactive surface recognizes the UID of the object via a radio frequency antenna, an array of capacitive sensor switches, or an array of magnetic sensor switches, and transmits that information to the processor.
  • the processor further accesses a database of correlation relationship between identifiers and music-related indicators stored in memory, and matches a music-related indicator for each identifier that the processor has recognized.
  • the processor further deduces the music piece from the structural pattern formed by a plurality of objects, based on the music-related indicators that are associated with the identifiers and the locations of each of the objects in the structural pattern.
  • the identifier of an object can also be a music -related indicator assigned to the object.
  • an object is a button, a card, a block, a figurine, or another 2D or 3D block structure that are amenable to be placed next to each other or on top of one another to form clearly recognizable 2D or 3D structural patterns, both the human eye and to the sensors and antennas of the interactive surface.
  • an object can also be a physical sheet placed on top of or next to the interactive surface, with music-related indicators printed on such physical sheet and incorporated into the structural pattern that processor translates into a music piece.
  • an electronic screen can be operatively linked to the interactive surface; with music-related indicators displayed on such electronic screen and incorporated into the structural pattern that processor translates into a music piece.
  • sensory accessories are operatively linked to the processor and provide interactive feedback to the user.
  • the sensory accessory is an audio device that can play the sound of the music piece generated by the processor.
  • the sensory accessory is a visual device that can show the notation of the music piece generated by the processor, with such notation written with typical Western music symbols such as ABCDEFG, staffs, clefs, notes, chords, rests, breaks, accidentals, and time signatures, or with typical Solfege music symbols such as Do, Re, Mi, Fa, Sol, La, Ti (or Si), or with simplified numerical music symbols such as 1, 2, 3, 4, 5, 6, 7.
  • FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
  • FIG. 2 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention.
  • FIG. 3 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention.
  • FIG. 4 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and a group of cards with various music -related indicators printed on them neatly placed on the music sheet in accordance with another embodiment of the present invention.
  • FIG. 5 is an exemplary schematic diagram illustrating two sets of designs for the seven music notes in the chromatic scale in accordance with one embodiment of the present invention.
  • FIG. 6 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch of a music note by half a step on the chromatic scale in accordance with one embodiment of the present invention.
  • FIG. 7 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch on a music note by an octave on the chromatic scale in accordance with one embodiment of the present invention.
  • FIG. 8 is an exemplary schematic diagram illustrating the design for symbols printed on the cards that are indicators of rhythm and duration of a music note in accordance with one embodiment of the present invention.
  • FIG. 9 is an exemplary schematic diagram illustrating the design for instrument cards in accordance with one embodiment of the present invention.
  • FIG. 10 is an exemplary schematic diagram illustrating the design of the chord cards based on the root note in the chromatic scale in accordance with one embodiment of the present invention.
  • FIG. 11 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and also a group of cards with various music-related indicators printed on them neatly placed on the music sheet using chord cards in accordance with one embodiment of the present invention.
  • FIG. 12 is an exemplary schematic diagram illustrating the design for chord variation cards based on a common root according to one embodiment of the present invention.
  • FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
  • FIG. 1 illustrates the core system and method of the present invention.
  • the system consists of an interactive surface 101 that is operatively linked to a computer system 102, which consists of a processor 103 and a memory unit 104.
  • the interactive surface 101 further comprises of a sensor or detection device 105 that is operatively linked to the computer system 102 of the interactive surface 101.
  • the sensor or detection device 105 is configured to detect the location and unique ID of an object 106 placed on or near the interactive surface 101.
  • the system described in FIG. 1 further consists of a user feedback device 107 such as audio speakers and/or lighting devices that are operatively linked to the computer system 102.
  • FIG. 2 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention, illustrating the process of creating a music piece using the system design described in FIG.1.
  • the melody created is that of the first eight measures of the famous Edelweiss melody from the show tune from the 1959 Rodgers and Hammerstein musical "The Sound of Music.”
  • the cards 202 imprinted with musical-related indicators are placed on the interactive surface 201. Some of these cards 202 are music note cards 203 that use the simplified numerical representation of the seven music notes. Other cards 204 are imprinted with music rhythm-related indicators ('- 'in this case representing the indicator for one beat), whereas some other cards 205 are pitch changing cards that are used to alter the pitch on musical note cards 203.
  • the bottom of the interactive surface 201 in FIG.2 also has function buttons for the user to interact with, including the play button 206, the replay button 207 and the pause button 208.
  • a user places music note, rhythm and pitch-altering cards 202 on top of the interactive surface 201 along the music progression lines 209 (except for pitch- altering cards 205 that are placed above music note cards 203).
  • the sensor or detection device picks up the UID of the cards 202 as well as it relative location vis-a-vis the surface of the interactive surface 201 and transmits this information to the computer system. The information is then stored in the computer system's memory unit.
  • the computer system will store within its memory the accompanying string of music notes, rhythm and pitch-modifying cards 202 and deduce in real-time the music melody that the user is creating.
  • the user can press the play button 206 in order to have the computer system play the melody back to the user via the feedback device, which typically consists of acoustic speakers.
  • FIG. 3 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention, illustrating an example system embodiment with increasing sophistication as compared to FIG 2.
  • the interactive surface 301 is operationally linked to the computer system 308 consisting of both a processor 306 and a memory unit 307.
  • a camera 304 (also operatively linked to the computer system 308) is set on top of pillar 303 which is affixed on the side of the interactive surface 301 in such a manner that the camera
  • the computer system 308 is also operatively linked to a speaker system 309 so as to provide audio feedback to the user.
  • the identifier is the same as the music-related indicator, whereas this would not be the case in an embodiment whereby the system uses RFID chips embedded into the cards in order to wireless communicate the card's UID with the computer system of the interactive surface. In such an instance, the location and orientation of the card would be determined by a set of sensors embedded across the surface of the interactive surface.
  • Another system embodiment has an interactive surface with an array of sensors designed to be able to accurately detect the UID, location and orientation information of an object placed upon the interactive surface.
  • Another system embodiment has an electronic screen as the interactive surface. This embodiment offers a large number of benefits in terms of both cost and ease of the information dissemination to the user.
  • FIG. 4 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and a group of cards with various music -related indicators printed on them neatly placed on the music sheet in accordance with another embodiment of the present invention.
  • FIG. 4 further depicts a close-up of the interactive surface 401 with a music sheet 402 placed on top of the interactive surface 401, and a selection of cards 403 with various music-related indicators printed on them neatly placed on the music sheet 402.
  • a music piece is created through the use of the 7 music notes (i.e. the cards with the letters C, D, E, F, G, A or B printed on them) as well other music -related cards.
  • FIG. 4 illustrates how a user could place the selection of cards 403 in the music creation area 415 to create a simple melody. Once a user has placed the cards on top of the music sheet 402 they can proceed to play their melody (by pressing the play 404 button), replay their melody (by pressing the replay button 405) or pause their melody (by pressing the pause button 406).
  • the cards 403 of the present invention each have a different music-related indicator printed on its surface. These indicators can take various forms and patterns and serve different functions. The cards can best be described as belonging to the following categories: music note; pitch modification; rhythm; melody; instrument; and chord.
  • These cards 403 are the core element of any music piece. They are placed along the dashed lines 407 on the music sheet 402 depicted in FIG. 4.
  • FIG. 5 is an exemplary schematic diagram illustrating two sets of designs for the seven music notes in the chromatic scale in accordance with one embodiment of the present invention.
  • the present embodiment comprises two different designs for the music note cards: staff notation and letter notation. These two sets of designs are depicted in FIG. 5 where each set of cards represent the same seven music notes in a chromatic scale.
  • the top and bottom two cards 501, 502 on the left hand-side depict the same note, Middle C, with two styles of presentation.
  • the top left-hand card 501 depicts the Middle C note using the staff notation with the pitch location and the bottom-left hand card 502 depicts the same Middle C note using the pitch name C. It will be noted that both designs are acceptable as the camera 304 and computer system 308 described in FIG. 3 are customized to recognize these indicators as the identifiers for these cards.
  • These cards 408, 409 are used to change the pitch of an individual music note card 403.
  • the present embodiment of the invention envisages these particular cards 408, 409 to be placed on top or superimposed on individual music note cards 403. This action would be instantly recognized by the camera 304 and the computer system 308 and the pitch of a melody would then change accordingly.
  • FIG. 6 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch of a music note by half a step on the chromatic scale - the accidentals, in accordance with one embodiment of the present invention.
  • the present embodiment includes two different types of Pitch Modification cards; cards that change the pitch on a music note by half a step on the chromatic scale and cards that change the pitch on a music note by an octave.
  • the symbol on the first card 601 in FIG.6 is an exemplary schematic diagram illustrating the design for the sharp accidental used to raise the pitch of the music by half a step.
  • the symbol on the second card 602 in FIG. 4 is the design used for the flat accidental used to lower the pitch by half a step.
  • FIG. 7 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch on a music note by an octave on the chromatic scale in accordance with one embodiment of the present invention.
  • the symbol on the first card 701 is an exemplary schematic diagram illustrating the design for raising the music note by an octave higher whereas the symbol on the second card 702 is the design used to lower the music note by an octave.
  • these cards 410 are used as indicators of rhythm and duration of music notes 403.
  • the present embodiment of the invention envisages these particular cards
  • rhythm cards 410 to be placed directly above individual music note cards 403 in the spaces denoted in the empty lines 411. It is important to point out that unlike the music note cards 403 which do not need to fill every box of the dashed lines 407, rhythm cards 410 need to fill in each box of the unfilled lines 411 situated above the music note card dashed lines 407. Furthermore the boxes of unfilled lines 411 that represent the rhythm must mirror the boxes on the music note dashed lines 407. Therefore, as illustrated in FIG. 4, rhythm cards are lined up on the unfilled lines
  • rhythm card 410 is placed on the rhythm unfilled lines 411, the computer system 308, via the camera 304, recognizes the symbols printed on top of the rhythm cards 410 and proceeds to process the information.
  • the present embodiment includes a number of different indicators for rhythm cards 410; each having different functions.
  • FIG. 8 is an exemplary schematic diagram illustrating the design for symbols printed on the cards that are indicators of rhythm and duration of a music note in accordance with one embodiment of the present invention.
  • the indicators illustrated in FIG. 8 are an international standard (widely used in Asian countries) for denoting rhythm and duration of music notes. Therefore, the author will not proceed to further explain the effect of these various symbols upon a melody.
  • these Melody cards 412 are placed at the bottom line of the music sheet 402. Assuming that the user would like to save the melody segment they have created in the example depicted in FIG. 4, all required for the user is to place a Melody card 412 in the square area 413 depicted at the bottom right of the music sheet 402. Adjacent to this square area 413 is a button with the symbol ">" 414 where the user assigns the Melody card 412 placed on the square area 413 with the melody that has been created on the board (through the use of music note, pitch modifications, and rhythm cards). Therefore, as illustrated in FIG. 4, the various music indicator cards are lined up in the "melody creation area"415 (depicted by the area within the thick lined square) and the user then proceeds to assign this melody to the Melody card 412 numbered 6.
  • These cards 418 are used to indicate to the computer system 308 which musical instrument should be used to play the melody created in the melody generation area 415. Referring back to FIG. 4, one can see that three Instrument cards 418 have been placed in the designated Instrument Assignment area 419 at the very bottom left of the music sheet 402. For this embodiment of the invention, only four instrument cards 418 can be used simultaneously to play a specific melody and in the example illustrated in FIG. 4, the Instrument cards 418 for the piano, the trumpet and the guitar have been selected. This would imply that if the user presses on the play 404 or replay 405 buttons then the melody created in the melody creation area 415 will be played using the acoustics of a piano, a trumpet and a guitar simultaneously.
  • FIG. 9 is an exemplary schematic diagram illustrating the design for instrument cards in accordance with one embodiment of the present invention.
  • the user In order for a user to modify the tempo (i.e., beats per minute) of the melody generated in the melody creation area, the user simply presses either the TEMPO up 420 or TEMPO down 423 buttons located at the bottom right-hand side of the music sheet 402. Interacting with these keys will increase or slow the tempo of the melody created in the melody creation area 415.
  • the user In order for a user to modify the musical tonality of the melody generated in the melody creation area, the user simply need to press either the KEY up 421 or KEY down 422 buttons located at the bottom right-hand side of the music sheet 402. Interacting with these keys will raise or lower the position of the entre chromatic scale of the melody created in the melody creation area 415.
  • Chord Cards The present embodiment of the invention also allows for chords to be used with the music sheet 402 through the use of Chord cards.
  • FIG. 10 is an exemplary schematic diagram illustrating the design of the chord cards based on the root note in the chromatic scale in accordance with one embodiment of the present invention.
  • chord cards are based on the root note in the chromatic scale. These cards are used in the same way Music Note cards are used in FIG. 4.
  • FIG. 11 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and also a group of cards with various music-related indicators printed on them neatly placed on the music sheet using chord cards in accordance with one embodiment of the present invention.
  • Chord cards 1101 based on the root note in the chromatic scale are placed in the melody creation area in order to create a more complex melody structure.
  • FIG. 12 is an exemplary schematic diagram illustrating the design for chord variation cards based on a common root according to one embodiment of the present invention.
  • Chord Variation cards are international standards (e.g. m - minor triad; aug - augmented triad; dim - diminished triad...etc) and will not be further explained within the scope of this document.
  • the Chord Variation cards 1102 are used in much the same manner Pitch Modification cards 408 are used in FIG.4. That is to say that a user superimposes them on top of the Chord cards 1101 in order to form a specific triad. For example, looking at the Chord card C 1103 which is a major triad in G Major, one can notice that the user has superimposed the Chord Variation card m6 1104 on this Chord card 1103. The result is that the G major triad is now transformed into a G minor 6 th triad.
  • the texture of the melody can be modified by placing a Music Instrument card 1105 within the designated area 1106 and then selecting one of the 6 instrument style option buttons 1107 located on the left hand-side of the melody creation area. For example, referring back to FIG. 11, a Piano Music Instrument Card 1105 has been placed in the designated area. Thus, a user could then proceed to select a different piano style by pressing any of the option buttons 1107. For example, the option button 1107 labeled 1 would play the grand piano, the option button 1107 labeled 2 would play the electric piano, and the option button 1107 would play the organ.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Educational Technology (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Stored Programmes (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Toys (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a system and method for learning, composing, accessing and playing music. The system includes a plurality of physical objects each includes an identifier and assigned a music-related indicator. The system further includes an interactive surface configured to recognize the identifier and location information relative to the interactive surface of a physical object placed on top of the interactive surface. Upon a plurality of objects being placed on the interactive surface to form a structural pattern, the processor is configured to derive a music piece from the structural pattern.

Description

System and Method for Learning, Composing, and Playing
Music with Physical Objects
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation in part of International Patent Application No. PCT/CN2014/079891, entitled "System and Method for Operating a Computer Program with Physical Objects", filed on June 13, 2014, which is a continuation in part of International Patent Application No. PCT/CN2014/072961, entitled "System and Method for Identifying an Object's ID and Location Relative to an Interactive Board," filed on March 6, 2014, which is a continuation in part to International Patent Application No. PCT/CN2014/071850, entitled "System and Method for Identifying an Object's ID and Location Relative to an Interactive Board," filed on January 30, 2014, which is continuation in part of International Patent Application No. PCT/CN2013/072481, entitled "System and Method for Interactive Board," filed on March 12, 2013. The entire disclosures of each of the above applications are incorporated herein by reference.
TECHNICAL FIELD
The present invention and its embodiments relates to the field of music application on electronic devices, and more particularly, an interactive surface using cards to compose and play music.
BACKGROUND
Music is the one of the most magnificent creations of the human race. Music is expressed in complex forms, syntaxes, colors and articulations that are rooted both in the human biology and elegant mathematics.
Learning, composing, accessing and playing music are among the most fundamental human activities. Other than being an art form practiced by professional musicians and enjoyed by almost everyone else in the world, numerous studies have shown that music is greatly beneficial to the cognitive development of children. Because of the advancement in technology over the last century, there is now little barrier for accessing and enjoying music. Music is performed in concert halls and recording studios; performance is recorded, stored and disseminated via a great variety of formats and channels. Consequently, almost any music is available at any time in any place to anyone with reasonable access.
Nonetheless, despite such technological advancement over the last century, there is still plenty of improvement potential for assisting learning and composing music by both professionals and novices, by the very senior and the very young, including as young as 2 to 3 years of age when the children have already developed an interest in music.
We see three major barriers to learning and composing music.
1. Skill required. The most commonly practiced format of learning music is the learning of a particular musical instrument. For example, parents often engage piano teachers to teach their children piano, while musicians play the piano to compose musical notes. Needless to say, it takes years of vigorous practice to become good at playing piano at the amateur level, a process quite often forced upon the children by the parents which costs time, money and possibly the children's very interest in music. It takes tremendous practice and sacrifice to become a pianist.
2. Tools available. Being good at one musical instrument does not readily give one the ability to compose a music piece, with the full range of tunes and rhythms. For example, being good at piano does not readily enable someone to compose music with the drum, the trumpet, or the violin. The popular software program GarageBand by Apple Inc. allows the user to create music with elements of percussion, wind and string instruments; however, the functionality in GarageBand relating to the construction of original music leaves much to be desired.
3. Music syntax. The syntax of music is highly complex. Terms such as chord, diatonic chord, accidental, major and minor and their many types, variations, equivalency and inversions are simply beyond the grasp of most children and the vast majority of the people who are not professional musicians and have not learned the intricacies of music theories. While anyone can "create music" by singing into a microphone or hitting a few keys on the electronic piano, without the precise language of music syntax, such rudimentary recording cannot be precisely described, nor can it be dissected, analyzed, or further improved upon. We therefore see the need to create a system that greatly reduces the skills required for learning and creating music, that makes the entire range of musical instruments easily available, and that allows sophisticated structure and complex syntax to be created based more on one's appreciation and imagination in music and less on one's mastery of the music syntax.
SUMMARY OF INVENTION
The present invention discloses a system and method for learning, composing, accessing and playing music. The system comprises: a plurality of objects configured to be placed next to or on top of each other to form a structural pattern, each object comprises an identifier and assigned a music -related indicator; an interactive surface configured to recognize the identifier and location information of an object placed on the interactive surface; a processor operatively linked to the interactive surface; a memory operatively linked to the processor and configured to store a database of correlation relationship between identifier and music-related indicator; and an acoustic or visual device so as to supply real-time feedback to the user.
In accordance with one embodiment of the present invention, once two or more objects are placed on the interactive surface, they form a structural pattern and the processor is configured to derive a music piece from the structural pattern.
In accordance with one embodiment of the present invention, a music -related indicator is derived from a music symbol, an Arabic numeral, a color, an icon, a figure, or a figurine that can be interpreted as a symbol of music syntax. A music symbol may be one of the followings: a single music note with pitch and duration; a single chord with the music note being the root; a rest and the duration of rest; accidentals that alter the pitch of a music note; dots or ties that modify the duration of a music note; major chords, minor chords, triad chords or seventh chords; key signatures that define the music piece being a major scale or a minor scale; raising or lowering the pitch of a music note in the same pitch class; symbols that define the texture, timbre, dynamics and articulation of the music piece, including those that are commonly used and those custom designed to enhance the music for a particular audience, sentiment and purpose.
A music-related indicator can also be a symbol chosen among a plurality of programming functions, including: start, end, repeat, condition, and jump that organize indicators into a structural pattern to be translated into a music piece by the processor; toggle, that, when used together with a music symbol, allows each of the variations of the symbol to be presented and chosen; equal and assign, that enable one object to be assigned to represent a first structural pattern, with the resulting object capable of being incorporated into a second structural pattern; record, retrieve, save, cancel, delete, group, ungroup, connect, disconnect, combine, and separate, that manage a music piece as an electronic file, and enable the synthesis of a larger music piece from a plurality of music pieces.
A music -related indicator can also be a symbol that represents musical instruments, including percussion, wind and string instruments, and a symbol that represents human voices and sounds from nature.
In accordance with one embodiment of the present invention, an identifier of an object is defined by a unique optical pattern of the object.
The unique optical pattern can be a marking of music notation, a marking of linguistic or mathematical notation, a marking of icons or graphics, or a unique pattern of 2D or 3D shape, color and texture visible or invisible to the human eye. Such identifiers are either pre-fabricated on the object, or marked on the object by a user with such marking being either permanent or erasable.
In accordance with one embodiment of the present invention, a camera affixed or otherwise operatively linked to the processor can recognize the unique optical pattern, and transmit that information to the processor. The processor further accesses a database of correlation relationship between identifiers and music-related indicators stored in memory, and matches a music-related indicator for each identifier that the processor has recognized. The processor further deduces the music piece from the structural pattern formed by a plurality of objects, based on the music -related indicators that are associated with the identifiers and the locations of each of the objects in the structural pattern.
In accordance with one embodiment of the present invention, an identifier of an object can also be defined by a unique identification code (UID) that is embedded in the object.
The UID can be encoded with a radio frequency identification chip, a unique pattern of capacitive tabs, or a unique pattern of magnetic tabs. In this embodiment, the interactive surface recognizes the UID of the object via a radio frequency antenna, an array of capacitive sensor switches, or an array of magnetic sensor switches, and transmits that information to the processor. The processor further accesses a database of correlation relationship between identifiers and music-related indicators stored in memory, and matches a music-related indicator for each identifier that the processor has recognized. The processor further deduces the music piece from the structural pattern formed by a plurality of objects, based on the music-related indicators that are associated with the identifiers and the locations of each of the objects in the structural pattern.
The identifier of an object can also be a music -related indicator assigned to the object.
In accordance with one embodiment of the present invention, an object is a button, a card, a block, a figurine, or another 2D or 3D block structure that are amenable to be placed next to each other or on top of one another to form clearly recognizable 2D or 3D structural patterns, both the human eye and to the sensors and antennas of the interactive surface.
In accordance with one embodiment of the present invention, an object can also be a physical sheet placed on top of or next to the interactive surface, with music-related indicators printed on such physical sheet and incorporated into the structural pattern that processor translates into a music piece.
In accordance with one embodiment of the present invention, an electronic screen can be operatively linked to the interactive surface; with music-related indicators displayed on such electronic screen and incorporated into the structural pattern that processor translates into a music piece.
In accordance with one embodiment of the present invention, sensory accessories are operatively linked to the processor and provide interactive feedback to the user.
In some embodiments, the sensory accessory is an audio device that can play the sound of the music piece generated by the processor.
In some embodiments, the sensory accessory is a visual device that can show the notation of the music piece generated by the processor, with such notation written with typical Western music symbols such as ABCDEFG, staffs, clefs, notes, chords, rests, breaks, accidentals, and time signatures, or with typical Solfege music symbols such as Do, Re, Mi, Fa, Sol, La, Ti (or Si), or with simplified numerical music symbols such as 1, 2, 3, 4, 5, 6, 7.
BRIEF DESCRIPTION OF THE DRAWINGS
To better illustrate the purposes, principles, concepts and advantages of the embodiments of the present invention, particularly how the embodiments of the present invention provide a novel and valuable user experience, various embodiments are further described in connection with the appended drawings. These drawings only serve as exemplary embodiments of the present invention and are not intended to limit the scope of the present invention.
FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
FIG. 2 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention.
FIG. 3 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention.
FIG. 4 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and a group of cards with various music -related indicators printed on them neatly placed on the music sheet in accordance with another embodiment of the present invention.
FIG. 5 is an exemplary schematic diagram illustrating two sets of designs for the seven music notes in the chromatic scale in accordance with one embodiment of the present invention.
FIG. 6 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch of a music note by half a step on the chromatic scale in accordance with one embodiment of the present invention.
FIG. 7 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch on a music note by an octave on the chromatic scale in accordance with one embodiment of the present invention.
FIG. 8 is an exemplary schematic diagram illustrating the design for symbols printed on the cards that are indicators of rhythm and duration of a music note in accordance with one embodiment of the present invention.
FIG. 9 is an exemplary schematic diagram illustrating the design for instrument cards in accordance with one embodiment of the present invention.
FIG. 10 is an exemplary schematic diagram illustrating the design of the chord cards based on the root note in the chromatic scale in accordance with one embodiment of the present invention.
FIG. 11 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and also a group of cards with various music-related indicators printed on them neatly placed on the music sheet using chord cards in accordance with one embodiment of the present invention.
FIG. 12 is an exemplary schematic diagram illustrating the design for chord variation cards based on a common root according to one embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
Various embodiments of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the present invention.
FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
FIG. 1 illustrates the core system and method of the present invention. The system consists of an interactive surface 101 that is operatively linked to a computer system 102, which consists of a processor 103 and a memory unit 104. The interactive surface 101 further comprises of a sensor or detection device 105 that is operatively linked to the computer system 102 of the interactive surface 101. The sensor or detection device 105 is configured to detect the location and unique ID of an object 106 placed on or near the interactive surface 101. The system described in FIG. 1 further consists of a user feedback device 107 such as audio speakers and/or lighting devices that are operatively linked to the computer system 102.
FIG. 2 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention, illustrating the process of creating a music piece using the system design described in FIG.1. In the example embodiment illustrated in FIG. 2, one can notice that the melody created is that of the first eight measures of the famous Edelweiss melody from the show tune from the 1959 Rodgers and Hammerstein musical "The Sound of Music."
In order to create this melody, the cards 202 imprinted with musical-related indicators are placed on the interactive surface 201. Some of these cards 202 are music note cards 203 that use the simplified numerical representation of the seven music notes. Other cards 204 are imprinted with music rhythm-related indicators ('- 'in this case representing the indicator for one beat), whereas some other cards 205 are pitch changing cards that are used to alter the pitch on musical note cards 203.
The bottom of the interactive surface 201 in FIG.2 also has function buttons for the user to interact with, including the play button 206, the replay button 207 and the pause button 208.
In order to create a melody using the embodiment described in FIG. 2, a user places music note, rhythm and pitch-altering cards 202 on top of the interactive surface 201 along the music progression lines 209 (except for pitch- altering cards 205 that are placed above music note cards 203). Once the cards 202 are appropriately placed on top of the interactive surface 201, the sensor or detection device picks up the UID of the cards 202 as well as it relative location vis-a-vis the surface of the interactive surface 201 and transmits this information to the computer system. The information is then stored in the computer system's memory unit. As a user places more and more cards 202 on top of the interactive surface 201 along the music progression lines 209, the computer system will store within its memory the accompanying string of music notes, rhythm and pitch-modifying cards 202 and deduce in real-time the music melody that the user is creating.
Finally, once a user is satisfied with the pattern of music cards 202 that he/she has created, the user can press the play button 206 in order to have the computer system play the melody back to the user via the feedback device, which typically consists of acoustic speakers.
Although the embodiment described in FIG 2 is a good illustration for creating music, the embodiments of the present invention can also include a number of add-ons in order to have a more complete and inclusive music creating device. FIG. 3 is an exemplary schematic diagram of the system in accordance with one embodiment of the present invention, illustrating an example system embodiment with increasing sophistication as compared to FIG 2. The interactive surface 301 is operationally linked to the computer system 308 consisting of both a processor 306 and a memory unit 307. A camera 304 (also operatively linked to the computer system 308) is set on top of pillar 303 which is affixed on the side of the interactive surface 301 in such a manner that the camera
304 has an overview of the whole area of the interactive surface 301. Objects such as cards
305 that are placed on top of the interactive surface are immediately detected by the camera 304 and the indicators printed on these cards 305 are recognized by the computer system 308 via the camera 304. Thus, the location and orientation of an object relative to the interactive surface 301 as well as the type of identifier (i.e., indicator) is recognized by the computer system 308. The computer system 308 is also operatively linked to a speaker system 309 so as to provide audio feedback to the user.
In the embodiment described in FIG. 3 the identifier is the same as the music-related indicator, whereas this would not be the case in an embodiment whereby the system uses RFID chips embedded into the cards in order to wireless communicate the card's UID with the computer system of the interactive surface. In such an instance, the location and orientation of the card would be determined by a set of sensors embedded across the surface of the interactive surface.
Another system embodiment has an interactive surface with an array of sensors designed to be able to accurately detect the UID, location and orientation information of an object placed upon the interactive surface.
Another system embodiment has an electronic screen as the interactive surface. This embodiment offers a large number of benefits in terms of both cost and ease of the information dissemination to the user.
Despite the various technologies and designs for the interactive surface, for the sake of simplicity, the present invention will be described using the system design illustrated in FIG. 3 (i.e., using a camera to detect a card's identifier/indicator, location and orientation information).
FIG. 4 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and a group of cards with various music -related indicators printed on them neatly placed on the music sheet in accordance with another embodiment of the present invention.
Using the system described in FIG. 3, FIG. 4 further depicts a close-up of the interactive surface 401 with a music sheet 402 placed on top of the interactive surface 401, and a selection of cards 403 with various music-related indicators printed on them neatly placed on the music sheet 402. In this particular embodiment, a music piece is created through the use of the 7 music notes (i.e. the cards with the letters C, D, E, F, G, A or B printed on them) as well other music -related cards.
The embodiment depicted in FIG. 4 illustrates how a user could place the selection of cards 403 in the music creation area 415 to create a simple melody. Once a user has placed the cards on top of the music sheet 402 they can proceed to play their melody (by pressing the play 404 button), replay their melody (by pressing the replay button 405) or pause their melody (by pressing the pause button 406).
The cards 403 of the present invention each have a different music-related indicator printed on its surface. These indicators can take various forms and patterns and serve different functions. The cards can best be described as belonging to the following categories: music note; pitch modification; rhythm; melody; instrument; and chord.
1. Music Note Cards
These cards 403 are the core element of any music piece. They are placed along the dashed lines 407 on the music sheet 402 depicted in FIG. 4.
FIG. 5 is an exemplary schematic diagram illustrating two sets of designs for the seven music notes in the chromatic scale in accordance with one embodiment of the present invention.
The present embodiment comprises two different designs for the music note cards: staff notation and letter notation. These two sets of designs are depicted in FIG. 5 where each set of cards represent the same seven music notes in a chromatic scale.
Referring to FIG. 5, the top and bottom two cards 501, 502 on the left hand-side depict the same note, Middle C, with two styles of presentation. The top left-hand card 501 depicts the Middle C note using the staff notation with the pitch location and the bottom-left hand card 502 depicts the same Middle C note using the pitch name C. It will be noted that both designs are acceptable as the camera 304 and computer system 308 described in FIG. 3 are customized to recognize these indicators as the identifiers for these cards.
Interestingly, if a user places the 7 cards (using either design) in the same order as depicted in FIG. 5 on top of the music sheet 402 (that is itself placed on top of the interactive surface 401) within the dashed lines 407 designed for music note cards, and then proceeds to press the play button 404, then, the computer system will successively play the solfege Do Re Mi Fa Sol La Si melody.
2. Pitch Modification Cards
These cards 408, 409 are used to change the pitch of an individual music note card 403. The present embodiment of the invention envisages these particular cards 408, 409 to be placed on top or superimposed on individual music note cards 403. This action would be instantly recognized by the camera 304 and the computer system 308 and the pitch of a melody would then change accordingly.
FIG. 6 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch of a music note by half a step on the chromatic scale - the accidentals, in accordance with one embodiment of the present invention.
The present embodiment includes two different types of Pitch Modification cards; cards that change the pitch on a music note by half a step on the chromatic scale and cards that change the pitch on a music note by an octave.
The symbol on the first card 601 in FIG.6 is an exemplary schematic diagram illustrating the design for the sharp accidental used to raise the pitch of the music by half a step. The symbol on the second card 602 in FIG. 4 is the design used for the flat accidental used to lower the pitch by half a step.
FIG. 7 is an exemplary schematic diagram illustrating the design of the two cards used to change the pitch on a music note by an octave on the chromatic scale in accordance with one embodiment of the present invention. Referring to FIG. 7, the symbol on the first card 701 is an exemplary schematic diagram illustrating the design for raising the music note by an octave higher whereas the symbol on the second card 702 is the design used to lower the music note by an octave.
Referring back to FIG. 4, one can see how the present embodiment would use Pitch Modification cards described in FIG. 6 and FIG. 7 to change the pitch of a music note card 403. Three cards 408 whose indicators have been denoted in FIG. 6 as the symbol for a flat accidental have been placed on top of three note cards 403. Also, a card 409 whose symbol has been denoted in FIG. 7 as the symbol for raising the music note by an octave higher has been placed on top of another note card 403.
In effect, superimposing these Pitch Modification cards 408, 409 upon note cards 403 causes the music notes in question to modify their pitch according to the pitch modification card indicator read by the computer system 308, via the camera 304. The computer system 308 will then instruct the speakers 309 to play the modified melody next time a user presses the play 404 or replay 405 buttons.
3. Rhythm Cards
Referring to FIG. 4, these cards 410 are used as indicators of rhythm and duration of music notes 403. The present embodiment of the invention envisages these particular cards
410 to be placed directly above individual music note cards 403 in the spaces denoted in the empty lines 411. It is important to point out that unlike the music note cards 403 which do not need to fill every box of the dashed lines 407, rhythm cards 410 need to fill in each box of the unfilled lines 411 situated above the music note card dashed lines 407. Furthermore the boxes of unfilled lines 411 that represent the rhythm must mirror the boxes on the music note dashed lines 407. Therefore, as illustrated in FIG. 4, rhythm cards are lined up on the unfilled lines
411 in order to create the rhythm of the melody.
Again, as with the music card 403 and pitch modification cards 408, the instant a rhythm card 410 is placed on the rhythm unfilled lines 411, the computer system 308, via the camera 304, recognizes the symbols printed on top of the rhythm cards 410 and proceeds to process the information.
The present embodiment includes a number of different indicators for rhythm cards 410; each having different functions. FIG. 8 is an exemplary schematic diagram illustrating the design for symbols printed on the cards that are indicators of rhythm and duration of a music note in accordance with one embodiment of the present invention. Anyone skilled in the art will recognize that the indicators illustrated in FIG. 8 are an international standard (widely used in Asian countries) for denoting rhythm and duration of music notes. Therefore, the author will not proceed to further explain the effect of these various symbols upon a melody.
4. Melody Cards:
4.1. Assigning a Melody to a Melody Card:
Once a user has placed the Music Note 403, Pitch Modification 408, and Rhythm cards 410 upon the music sheet 402 (itself placed on top of the interactive surface 401) and is satisfied with the melody segment that he/she has created, they can choose to save this segment through the use of Melody cards 412.
Referring to FIG. 4, these Melody cards 412 are placed at the bottom line of the music sheet 402. Assuming that the user would like to save the melody segment they have created in the example depicted in FIG. 4, all required for the user is to place a Melody card 412 in the square area 413 depicted at the bottom right of the music sheet 402. Adjacent to this square area 413 is a button with the symbol ">" 414 where the user assigns the Melody card 412 placed on the square area 413 with the melody that has been created on the board (through the use of music note, pitch modifications, and rhythm cards). Therefore, as illustrated in FIG. 4, the various music indicator cards are lined up in the "melody creation area"415 (depicted by the area within the thick lined square) and the user then proceeds to assign this melody to the Melody card 412 numbered 6.
4.2. Assigning Multiple Melodies to a Melody Card:
By the same approach described above, once multiple melodies have been assigned to multiple Melody cards 412, these multiple melodies can then be assigned to one Melody card.
In order to do so, all a user needs to do is to place sequentially multiple Melody cards 412 (each with a melody already assigned to it) into the "melody creation area" 416 depicted by the lowest dashed line of the music sheet 402. Once again, the user then proceeds to place a new Melody card 412 on top of the square area 413 on the right of the dashed line 416 and then press the "=" button 417 adjacent to it. This will cause the sequence of the melody cards placed on the dashed line 416 to be assigned to the new melody card and the main theme of a complete music piece is created.
5. Instrument Cards
These cards 418 are used to indicate to the computer system 308 which musical instrument should be used to play the melody created in the melody generation area 415. Referring back to FIG. 4, one can see that three Instrument cards 418 have been placed in the designated Instrument Assignment area 419 at the very bottom left of the music sheet 402. For this embodiment of the invention, only four instrument cards 418 can be used simultaneously to play a specific melody and in the example illustrated in FIG. 4, the Instrument cards 418 for the piano, the trumpet and the guitar have been selected. This would imply that if the user presses on the play 404 or replay 405 buttons then the melody created in the melody creation area 415 will be played using the acoustics of a piano, a trumpet and a guitar simultaneously.
FIG. 9 is an exemplary schematic diagram illustrating the design for instrument cards in accordance with one embodiment of the present invention.
6. The Tempo Buttons
In order for a user to modify the tempo (i.e., beats per minute) of the melody generated in the melody creation area, the user simply presses either the TEMPO up 420 or TEMPO down 423 buttons located at the bottom right-hand side of the music sheet 402. Interacting with these keys will increase or slow the tempo of the melody created in the melody creation area 415.
7. Key Buttons
In order for a user to modify the musical tonality of the melody generated in the melody creation area, the user simply need to press either the KEY up 421 or KEY down 422 buttons located at the bottom right-hand side of the music sheet 402. Interacting with these keys will raise or lower the position of the entre chromatic scale of the melody created in the melody creation area 415.
8. Chord Cards The present embodiment of the invention also allows for chords to be used with the music sheet 402 through the use of Chord cards.
FIG. 10 is an exemplary schematic diagram illustrating the design of the chord cards based on the root note in the chromatic scale in accordance with one embodiment of the present invention.
Referring to FIG. 10, one can see the design of chord cards is based on the root note in the chromatic scale. These cards are used in the same way Music Note cards are used in FIG. 4.
FIG. 11 is an exemplary schematic diagram illustrating a close-up of the interactive surface with a music sheet placed on top of the interactive surface and also a group of cards with various music-related indicators printed on them neatly placed on the music sheet using chord cards in accordance with one embodiment of the present invention.
Referring to FIG. 11, one can see how that the Chord cards 1101 based on the root note in the chromatic scale are placed in the melody creation area in order to create a more complex melody structure.
FIG. 12 is an exemplary schematic diagram illustrating the design for chord variation cards based on a common root according to one embodiment of the present invention.
Referring to FIG. 12 one can note that the symbols used on these Chord Variation cards are international standards (e.g. m - minor triad; aug - augmented triad; dim - diminished triad...etc) and will not be further explained within the scope of this document.
Referring back to FIG. 11, the Chord Variation cards 1102 are used in much the same manner Pitch Modification cards 408 are used in FIG.4. That is to say that a user superimposes them on top of the Chord cards 1101 in order to form a specific triad. For example, looking at the Chord card C 1103 which is a major triad in G Major, one can notice that the user has superimposed the Chord Variation card m6 1104 on this Chord card 1103. The result is that the G major triad is now transformed into a G minor 6th triad.
9. Texture Modification Finally the texture of the melody can be modified by placing a Music Instrument card 1105 within the designated area 1106 and then selecting one of the 6 instrument style option buttons 1107 located on the left hand-side of the melody creation area. For example, referring back to FIG. 11, a Piano Music Instrument Card 1105 has been placed in the designated area. Thus, a user could then proceed to select a different piano style by pressing any of the option buttons 1107. For example, the option button 1107 labeled 1 would play the grand piano, the option button 1107 labeled 2 would play the electric piano, and the option button 1107 would play the organ.
Furthermore, in the case that no Instrument Card 1105 is placed on the designated area 1106; then the user can select any 6 Chord styles (e.g. , arpeggio, rolling of the octaves, etc.) by pressing any of the option button 1107.

Claims

1. A system for learning, composing and playing music, comprising:
a plurality of objects configured to be placed next to or on top of each other to form a structural pattern, each object comprises an identifier and assigned a music -related indicator; an interactive surface configured to recognize the identifier and location information of an object placed on or near the interactive surface;
a processor operatively linked to the interactive surface; and
a memory operatively linked to the processor and configured to store a database of correlation relationship between identifier and music-related indicator,
wherein upon the plurality of objects being placed on or near the interactive surface to form a structural pattern, the processor is configured to derive a music piece from the structural pattern.
2. The system of claim 1, wherein the music -related indicator of a first object comprises a music symbol, and the processor is configured to derive the music piece in accordance with the music symbol and location information of the first object.
3. The system of claim 2, wherein the music-related indicator for a second object comprises a programming symbol, and upon the first object and the second object being placed on or near the interactive surface, the processor is configured to program the music symbol of the first object in accordance with the programming symbol of the second object.
4. The system of claim 2, wherein the music-related indicator for a third object comprises a music instrument symbol, and upon the first object and the third object being placed on or near the interactive surface, the processor is configured to derive the music piece in accordance with the music symbol of the first object and the music instrument symbol of the third object.
5. The system of claim 1, wherein the identifier of the object comprises a unique identification code (UID), and the UID is encoded with a device selected from a group consisting of a radio frequency identification chip, a pattern of capacitive tabs, and a pattern of magnetic tabs.
6. The system of claim 1, wherein the identifier of the object correlates to a unique optical pattern, and the interactive surface is configured to recognize the unique optical pattern through a camera or a sensor array that is operatively linked to the interactive surface.
7. The system of claim 6, wherein the unique optical pattern is pre-fabricated on the object.
8. The system of claim 6, wherein the unique optical pattern is a marking on the object by a user.
9. The system of claim 1, wherein the identifier of the object is a music-related indicator assigned to the object.
10. The system of claim 1, wherein an object comprises a physical sheet placed on top of the interactive surface.
11. The system of claim 1, further comprising an electronic screen operatively linked to the interactive surface and configured to display a music -related indicator.
12. The system of claim 1, further comprising a sensory accessory operatively linked to the processor.
13. The system of claim 12, wherein the sensory accessory comprises an audio device, and the processor is configured to play the music piece on the audio device.
14. The system of claim 12, wherein the sensory accessory comprises a display device, and the processor is configured to display a notation of the music piece on the display device.
15. A method for learning, composing and playing music, the method comprising:
placing a plurality of objects next to or on top of each other on an interactive surface to form a structural pattern, each object comprises an identifier and is assigned a music-related indicator;
recognizing the identifier and location information of an object;
deriving the music -related indicator from the identifier of the object; and
deriving a music piece from the structural pattern.
16. The method of claim 15, wherein the music-related indicator of a first object comprises a music symbol, and the method further comprises deriving the music piece in accordance with the music symbol and location information of the first object.
17. The method of claim 16, wherein the music-related indicator for a second object comprises a programming symbol, and the method further comprises upon the first object and the second object being placed on or near the interactive surface, programming the music symbol of the first object in accordance with the programming symbol of the second object.
18. The method of claim 16, wherein the music-related indicator for a third object comprises a music instrument symbol, and the method further comprises, upon the first object and the third object being placed on or near the interactive surface, deriving the music piece in accordance with the music symbol of the first object and the music instrument symbol of the third object.
19. The method of claim 15, wherein the identifier of the object comprises a unique identification code (UID), and the UID is encoded with a device selected from a group consisting of a radio frequency identification chip, a pattern of capacitive tabs, and a pattern of magnetic tabs.
20. The method of claim 15, wherein the identifier of the object correlates to a unique optical pattern, and the method further comprises recognizing the unique optical pattern through a camera or a sensor array that is operatively linked to the interactive surface.
21. The method of claim 20, further comprising pre-fabricating the unique optical pattern on the object.
22. The method of claim 20, further comprising marking the object to form the unique optical pattern.
23. The system of claim 15, wherein the identifier of the object is a music -related indicator assigned to the object.
24. The method of claim 15, wherein an object comprises a physical sheet and the method further comprises placing the physical sheet on top of the interactive surface.
25. The method of claim 15, further comprising an electronic screen operatively linked to the interactive surface and displays a music -related symbol.
26. The method of claim 15, further comprising sending the music piece to a sensory accessory.
27. The method of claim 26, wherein the sensory accessory comprises an audio device and the method further comprises playing the music piece on the audio device.
28. The method of claim 26, wherein the sensory accessory comprises a display device and the method further comprises displaying a notation of the music piece on the display device.
PCT/CN2014/080317 2013-03-12 2014-06-19 System and method for learning,composing,and playing music with physical objects Ceased WO2015113360A1 (en)

Priority Applications (20)

Application Number Priority Date Filing Date Title
KR1020167020173A KR20160104644A (en) 2014-01-30 2014-06-19 System and method for learning, composing, and playing music with physical objects
CN201480043673.3A CN105453168A (en) 2014-01-30 2014-06-19 Systems and methods for learning, composing and playing music with objects
JP2016548114A JP6429336B2 (en) 2013-03-12 2014-06-19 System and method for learning, composing and playing music with physical objects
EP14880685.4A EP3100257A4 (en) 2014-01-30 2014-06-19 System and method for learning,composing,and playing music with physical objects
PCT/CN2014/081721 WO2015113376A1 (en) 2014-01-30 2014-07-07 System and method for computer programming with physical objects on interactive surface
EP14880674.8A EP3100147A4 (en) 2014-01-30 2014-07-07 System and method for computer programming with physical objects on interactive surface
CN201480041861.2A CN105765512A (en) 2014-01-30 2014-07-07 System and method for computer programming with physical objects on interactive surface
JP2016548134A JP6326143B2 (en) 2013-03-12 2014-07-07 System and method for computer programming with physical objects in interactive surfaces
PCT/CN2014/082483 WO2015113381A1 (en) 2014-01-30 2014-07-18 System and method to learn a language using physical objects on an interactive surface
US14/489,199 US9183755B2 (en) 2013-03-12 2014-09-17 System and method for learning, composing, and playing music with physical objects
CN201480073599.XA CN105917293B (en) 2014-01-30 2014-11-14 System and method for interacting with language elements using objects
PCT/CN2014/091143 WO2015113433A1 (en) 2014-01-30 2014-11-14 System and method to interact with elements of a language using physical objects
US14/561,959 US9268535B2 (en) 2013-03-12 2014-12-05 System and method for computer programming with physical objects on an interactive surface
PCT/CN2015/070162 WO2015113457A1 (en) 2014-01-30 2015-01-06 Apparatus and method to enhance expressive qualities of digital music
KR1020167020190A KR101813557B1 (en) 2014-01-30 2015-01-06 Apparatus and method to enhance expressive qualities of digital music
CN201580000167.0A CN105027192B (en) 2014-01-30 2015-01-06 Apparatus and method for enhancing the expressiveness of digital music
EP15743177.6A EP3100258A4 (en) 2014-01-30 2015-01-06 Apparatus and method to enhance expressive qualities of digital music
JP2016548113A JP2017507349A (en) 2013-03-12 2015-01-06 Apparatus and method for enhancing the expression quality of digital music
US14/737,514 US9299330B2 (en) 2014-01-30 2015-06-12 Apparatus and method to enhance the expressive qualities of digital music
US14/830,757 US20160180734A1 (en) 2014-01-30 2015-08-20 System and method to interact with elements of a language using physical objects

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CNPCT/CN2014/071850 2014-01-30
PCT/CN2014/071850 WO2014139349A1 (en) 2013-03-12 2014-01-30 System and method for identifying an object's id and location relative to an interactive surface
PCT/CN2014/072961 WO2014139369A1 (en) 2013-03-12 2014-03-06 System and method for identifying object's id and location relative to interactive surface
CNPCT/CN2014/072961 2014-03-06
PCT/CN2014/079891 WO2015113358A1 (en) 2013-03-12 2014-06-13 System and method for operating computer program with physical objects
CNPCT/CN2014/079891 2014-06-13

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2014/079891 Continuation-In-Part WO2015113358A1 (en) 2013-03-12 2014-06-13 System and method for operating computer program with physical objects
PCT/CN2014/079894 Continuation-In-Part WO2015188388A1 (en) 2014-01-30 2014-06-13 Proteinase

Related Child Applications (3)

Application Number Title Priority Date Filing Date
PCT/CN2014/081721 Continuation-In-Part WO2015113376A1 (en) 2013-03-12 2014-07-07 System and method for computer programming with physical objects on interactive surface
US14/489,199 Continuation US9183755B2 (en) 2013-03-12 2014-09-17 System and method for learning, composing, and playing music with physical objects
PCT/CN2015/070162 Continuation-In-Part WO2015113457A1 (en) 2013-03-12 2015-01-06 Apparatus and method to enhance expressive qualities of digital music

Publications (1)

Publication Number Publication Date
WO2015113360A1 true WO2015113360A1 (en) 2015-08-06

Family

ID=53756210

Family Applications (3)

Application Number Title Priority Date Filing Date
PCT/CN2014/080317 Ceased WO2015113360A1 (en) 2013-03-12 2014-06-19 System and method for learning,composing,and playing music with physical objects
PCT/CN2014/081721 Ceased WO2015113376A1 (en) 2013-03-12 2014-07-07 System and method for computer programming with physical objects on interactive surface
PCT/CN2014/082483 Ceased WO2015113381A1 (en) 2014-01-30 2014-07-18 System and method to learn a language using physical objects on an interactive surface

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/CN2014/081721 Ceased WO2015113376A1 (en) 2013-03-12 2014-07-07 System and method for computer programming with physical objects on interactive surface
PCT/CN2014/082483 Ceased WO2015113381A1 (en) 2014-01-30 2014-07-18 System and method to learn a language using physical objects on an interactive surface

Country Status (4)

Country Link
US (1) US20160162040A1 (en)
EP (2) EP3100257A4 (en)
CN (2) CN106062677A (en)
WO (3) WO2015113360A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017112770A1 (en) * 2015-12-23 2017-06-29 Harmonix Music Systems, Inc. Apparatus, systems, and methods for music generation
WO2018021519A1 (en) * 2016-07-29 2018-02-01 宮浦清 Music education assistance system
US11670188B2 (en) 2020-12-02 2023-06-06 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11893898B2 (en) 2020-12-02 2024-02-06 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11900825B2 (en) 2020-12-02 2024-02-13 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11972693B2 (en) 2020-12-02 2024-04-30 Joytunes Ltd. Method, device, system and apparatus for creating and/or selecting exercises for learning playing a music instrument
US12067961B2 (en) * 2021-06-08 2024-08-20 Koto Co., Ltd. Musical instrument system
US20240371346A1 (en) * 2023-05-04 2024-11-07 Loops Lab Ltd Apparatus, System and Methods for Creating Musical Compositions
US12243437B2 (en) 2020-12-02 2025-03-04 Simply Ltd. Crowd-based device configuration selection of a music teaching system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160085518A1 (en) * 2014-09-21 2016-03-24 Jang Hee I Systems and methods for imaging and generation of executable processor instructions based on ordered objects
CN106730907B (en) * 2016-12-02 2022-04-22 浙江机电职业技术学院 Desktop stacking balance toy and using method thereof
CN108564148A (en) * 2018-03-30 2018-09-21 孙博 Track recognizing method, system, computer equipment and the storage medium of interactive label
CN110327615B (en) * 2019-06-19 2022-11-01 深圳数联天下智能科技有限公司 Method for determining object combination mode and related device
US20210170265A1 (en) * 2019-12-10 2021-06-10 Sydney Ella Curran Electronic toy

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1369091A (en) * 1999-06-09 2002-09-11 英诺普雷有限公司 Device for composing and arranging music
CN101800046A (en) * 2010-01-11 2010-08-11 北京中星微电子有限公司 Method and device for generating MIDI music according to notes
CN102930861A (en) * 2012-11-03 2013-02-13 徐国元 System and device of digital music

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5481740A (en) * 1986-04-14 1996-01-02 National Instruments Corporation Method and apparatus for providing autoprobe features in a graphical data flow diagram
JP4048939B2 (en) * 2002-05-17 2008-02-20 ソニー株式会社 Music device with interface element
AU2003900861A0 (en) * 2003-02-26 2003-03-13 Silverbrook Research Pty Ltd Methods,systems and apparatus (NPS042)
FR2860985B1 (en) * 2003-10-20 2005-12-30 Numicom ELECTRONIC LUDO-EDUCATIONAL ASSEMBLY WITH COMMUNICATING ELEMENTS WITH RADIO FREQUENCY LABEL
US7397464B1 (en) * 2004-04-30 2008-07-08 Microsoft Corporation Associating application states with a physical object
US7205896B2 (en) * 2005-02-23 2007-04-17 G-Time Electronic Co., Ltd. RFID reader having multi-dimensional antenna array
EP1896151A2 (en) * 2005-05-11 2008-03-12 Koninklijke Philips Electronics N.V. Computer controlled pawn
US20080084271A1 (en) * 2006-10-06 2008-04-10 Denny Jaeger Continuous variable wireless data input to RFID reader
CN100585539C (en) * 2006-12-21 2010-01-27 何华科技股份有限公司 Interactive electronic learning white board and operation method thereof
US8686834B2 (en) * 2007-11-20 2014-04-01 Samsung Electronics Co., Ltd. Terminal having radio frequency function and method of processing information of the terminal
DE102008057389B4 (en) * 2008-11-14 2011-03-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Transporting an object over a surface
CN101637655A (en) * 2009-02-27 2010-02-03 黄煜能 Radio frequency (RF) entertainment or instructional system
CN102039045A (en) * 2009-10-12 2011-05-04 朱立圣 Electronic chessboard type game system
CN102455930A (en) * 2011-09-19 2012-05-16 中标软件有限公司 Method for classifying and installing application programs
CN103566580B (en) * 2012-08-09 2018-08-07 上海科斗电子科技有限公司 Electronic chess-plate system
CN103092277A (en) * 2013-01-31 2013-05-08 北京恒华伟业科技股份有限公司 Device and implementation method thereof for identifying radio frequency identification (RFID) electronic tags based on Pad
CN103446757B (en) * 2013-07-31 2018-05-08 北京智谷睿拓技术服务有限公司 Chess and card and entertainment device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1369091A (en) * 1999-06-09 2002-09-11 英诺普雷有限公司 Device for composing and arranging music
CN101800046A (en) * 2010-01-11 2010-08-11 北京中星微电子有限公司 Method and device for generating MIDI music according to notes
CN102930861A (en) * 2012-11-03 2013-02-13 徐国元 System and device of digital music

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3100257A4 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017112770A1 (en) * 2015-12-23 2017-06-29 Harmonix Music Systems, Inc. Apparatus, systems, and methods for music generation
US10102836B2 (en) 2015-12-23 2018-10-16 Harmonix Music Systems, Inc. Apparatus, systems, and methods for music generation
JP2019507389A (en) * 2015-12-23 2019-03-14 ハーモニクス ミュージック システムズ,インコーポレイテッド Apparatus, system and method for generating music
WO2018021519A1 (en) * 2016-07-29 2018-02-01 宮浦清 Music education assistance system
JPWO2018021519A1 (en) * 2016-07-29 2019-12-12 清 宮浦 Music education support system
JP7053465B2 (en) 2016-07-29 2022-04-12 清 宮浦 Music education support system
US11670188B2 (en) 2020-12-02 2023-06-06 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11893898B2 (en) 2020-12-02 2024-02-06 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11900825B2 (en) 2020-12-02 2024-02-13 Joytunes Ltd. Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
US11972693B2 (en) 2020-12-02 2024-04-30 Joytunes Ltd. Method, device, system and apparatus for creating and/or selecting exercises for learning playing a music instrument
US12243437B2 (en) 2020-12-02 2025-03-04 Simply Ltd. Crowd-based device configuration selection of a music teaching system
US12067961B2 (en) * 2021-06-08 2024-08-20 Koto Co., Ltd. Musical instrument system
US20240371346A1 (en) * 2023-05-04 2024-11-07 Loops Lab Ltd Apparatus, System and Methods for Creating Musical Compositions
US12412553B2 (en) * 2023-05-04 2025-09-09 Loops Lab Ltd. Apparatus, system and methods for creating musical compositions

Also Published As

Publication number Publication date
WO2015113376A1 (en) 2015-08-06
WO2015113381A1 (en) 2015-08-06
EP3100257A4 (en) 2017-01-11
CN106062677A (en) 2016-10-26
EP3100257A1 (en) 2016-12-07
CN106061570A (en) 2016-10-26
US20160162040A1 (en) 2016-06-09
EP3100147A1 (en) 2016-12-07
EP3100147A4 (en) 2017-03-22

Similar Documents

Publication Publication Date Title
US9183755B2 (en) System and method for learning, composing, and playing music with physical objects
WO2015113360A1 (en) System and method for learning,composing,and playing music with physical objects
US7982115B2 (en) Music notation system
US7932454B2 (en) System and method for musical instruction
US8912418B1 (en) Music notation system for two dimensional keyboard
JP2013515288A (en) Educational string instrument touch screen simulation
CN101681565A (en) Apparatus and method for visualizing music and other sounds
CA2504004A1 (en) Training system for musical instruments
KR101931087B1 (en) Method for providing a melody recording based on user humming melody and apparatus for the same
CN106952510B (en) Pitch Calibrator
US11302212B1 (en) Device for teaching music performance through tactile pitch association and methods of use
JP7157377B2 (en) Performance information display device, performance information display method, performance information display program, and electronic musical instrument
CN105453168A (en) Systems and methods for learning, composing and playing music with objects
US20050172780A1 (en) Fingering guide displaying apparatus for musical instrument and computer program therefor
KR20160104644A (en) System and method for learning, composing, and playing music with physical objects
US12067961B2 (en) Musical instrument system
CN118942431A (en) Twelve-semitone isomorphic musical instruments and their corresponding twelve-semitone isomorphic notation
US11308926B2 (en) Method and system for composing music with chord accompaniment
CN210804855U (en) Fast music piano for beginner
TW201405544A (en) Instrument and musical score
WO2020154982A1 (en) System and method for composing music with physical cards
CN216697565U (en) Learning tool for cultivating music literacy and thinking
US7554025B2 (en) Visual chord keyboard instructional method
JP2002318579A (en) Musical score for performance, display device, and notation of musical score for performance
KR20140065953A (en) Method for displaying of playing keyboard information

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480043673.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14880685

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016548114

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20167020173

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2014880685

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014880685

Country of ref document: EP