WO2017138596A1 - Dispositif de traitement de signaux audio, dispositif de lecture audio et instrument de musique électronique - Google Patents

Dispositif de traitement de signaux audio, dispositif de lecture audio et instrument de musique électronique Download PDF

Info

Publication number
WO2017138596A1
WO2017138596A1 PCT/JP2017/004682 JP2017004682W WO2017138596A1 WO 2017138596 A1 WO2017138596 A1 WO 2017138596A1 JP 2017004682 W JP2017004682 W JP 2017004682W WO 2017138596 A1 WO2017138596 A1 WO 2017138596A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound source
virtual sound
speaker
signal processing
delay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/004682
Other languages
English (en)
Japanese (ja)
Inventor
磯崎　善政
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Publication of WO2017138596A1 publication Critical patent/WO2017138596A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers

Definitions

  • the present invention relates to an acoustic signal processing device that generates an acoustic signal representing sound emitted from a sounding body such as an acoustic instrument, an acoustic reproduction device and an electronic musical instrument to which the acoustic signal processing device is applied.
  • Patent Document 1 describes an electronic piano provided with a plurality of speakers. These speakers are arranged in the horizontal direction (key arrangement direction) and are directed toward the performer. This electronic piano simulates the sound image of an acoustic grand piano using wavefront synthesis technology. A listener who plays the electronic piano seems to have a housing (a portion provided with a soundboard and strings, which generates sound) like an acoustic grand piano behind the plurality of speakers. A sense of realism.
  • an acoustic signal is generated that represents sound emitted from a virtual sound source that is provided in a device including a speaker and is virtually arranged at a position different from the speaker.
  • An acoustic signal processing apparatus an acquisition means for acquiring an original signal representing sound emitted from a sounding body of a predetermined apparatus, and a frequency of the original signal provided corresponding to a plurality of natural frequencies of the virtual sound source
  • a plurality of band-pass filters that respectively extract components
  • a plurality of delay means provided corresponding to a plurality of natural frequencies of the virtual sound source, the vibration form of the virtual sound source, the position of the speaker, and the virtual
  • a plurality of delay means for delaying each extracted frequency component according to the distance to the position of the sound source, and an adder for adding the frequency components respectively output from the plurality of delay means
  • the plurality of delay means may delay the frequency component according to the vibration form of the virtual sound source and the distance between the position of the speaker and the position of the antinode of the vibration of the virtual sound source.
  • the acoustic signal processing apparatus may further include a bypass unit that supplies the original signal output from the acquisition unit to the addition unit.
  • the speaker and an acquisition unit that acquires an original signal representing sound emitted from a sounding body of a predetermined device are provided, and the position different from the speaker is based on the acquired original signal.
  • An acoustic signal processing unit that generates an acoustic signal representing sound emitted from a virtual sound source virtually arranged on the sound source, wherein the acoustic signal processing unit includes a plurality of virtual sound sources.
  • a plurality of band-pass filters provided corresponding to the natural frequency, respectively extracting the frequency components of the original signal or the audio signal, and a plurality of delay means provided corresponding to the plurality of natural frequencies of the virtual sound source.
  • a plurality of delay means for delaying each extracted frequency component according to the vibration mode of the virtual sound source and the distance between the position of the speaker and the position of the virtual sound source; And adding means for adding output frequency components from each of the delay means with a sound reproduction device is also provided.
  • the plurality of delay means may delay the frequency component according to the vibration form of the virtual sound source and the distance between the position of the speaker and the position of the antinode of the vibration of the virtual sound source.
  • the reproduction means for reproducing the original signal representing the sound emitted from the sounding body of the predetermined device according to the speaker and the predetermined acoustic synthesis algorithm
  • An acoustic signal processing unit that generates an acoustic signal representing sound emitted from a virtual sound source that is virtually arranged at a position different from the speaker, wherein the acoustic signal processing unit includes: A plurality of band-pass filters provided corresponding to a plurality of natural frequencies of the virtual sound source and extracting frequency components of the original signal, respectively, and a plurality of delay means provided corresponding to the plurality of natural frequencies of the virtual sound source A plurality of delay means for delaying each extracted frequency component according to a vibration form of the virtual sound source and a distance between the position of the speaker and the position of the virtual sound source; With a, adding means for adding the frequency components outputted from each of said plurality of delay means, the electronic musical instrument is also provided.
  • the plurality of delay means for adding the frequency components outputted from each of said plurality
  • a predetermined centering on each natural frequency of the virtually arranged sounding body (or part of the sounding body) of the original signal is extracted.
  • Each extracted frequency component is delayed according to the arrangement position of the sounding body (or a part of the sounding body) (that is, the distance between the sounding body (or a part of the sounding body) and the speaker) and the phase characteristics.
  • the arrangement position of the sounding body (or a part of the sounding body) that is, the distance between the sounding body (or a part of the sounding body) and the speaker
  • the phase characteristics are added.
  • a musical tone signal processing apparatus that generates a musical tone signal as described above is composed of relatively simple components such as a bandpass filter and a delay unit. That is, expensive hardware and complicated software are unnecessary.
  • FIG. 4 is a block diagram of the tone generator circuit of FIG. 3.
  • surface which shows the phase characteristic in each vibration mode of a virtual sound board.
  • surface which shows the delay time according to the distance from each area
  • surface which shows the delay time according to the phase characteristic in each vibration mode which is the delay time of a musical sound signal.
  • a musical tone signal processing apparatus PP according to an embodiment of the acoustic signal processing apparatus of the present invention and an electronic piano UP to which the musical tone signal processing apparatus PP is applied will be described.
  • the shape of the housing of the electronic piano UP is the same as the shape of the housing of the acoustic upright piano, as shown in FIGS. That is, the electronic piano UP includes an upper plate TB, a lower plate UB, a right plate RB and a left plate LB, a front plate FB, and a rear plate BB.
  • a keyboard device KY, a pedal device PD, a sound system SS, and a musical tone signal generator SG are assembled in the casing of the electronic piano UP, as in a conventional electronic piano.
  • the keyboard device KY and the pedal device PD are each provided with a plurality of keys and a plurality of pedal levers operated by the performer, and operation information indicating the operation content (for example, information specifying the operated key, the depth of depression of the pedal lever) And the like) are supplied to the tone signal generator SG.
  • the musical tone signal generator SG includes a setting operator 11, a computer unit 12, a display unit 13, a storage device 14, an external interface unit 15, and a sound source unit 16, which are connected via a bus BS.
  • the keyboard device KY and the pedal device PD are connected to the bus BS through an interface unit (not shown).
  • the setting operator 11 includes a switch corresponding to an on / off operation (for example, a numeric keypad for inputting a numerical value), a volume or rotary encoder corresponding to a rotation operation, a volume or linear encoder corresponding to a slide operation, a mouse, a touch panel, and the like. Become.
  • the setting operator 11 is used for selecting a timbre, selecting a temperament, and the like.
  • operation information representing the operation content is supplied to the computer unit 12 described later via the bus BS.
  • the computer unit 12 includes a CPU 12a, a ROM 12b, and a RAM 12c connected to the bus BS.
  • the CPU 12a supplies musical sound information related to the musical sound to be generated to the sound source unit 16 based on the operation information indicating the operation of the key and the operation of the pedal lever.
  • the musical sound information includes information for specifying waveform data to be read from a waveform memory WM, which will be described later.
  • the ROM 12b stores various data such as initial setting parameters, graphic data for generating display data representing an image displayed on the display 13, and character data, in addition to a program for defining the operation of the CPU 12a. .
  • the RAM 12c temporarily stores data necessary for executing various programs.
  • the display 13 is configured by a liquid crystal display (LCD). Display data representing the contents to be displayed is supplied from the computer unit 12 to the display unit 13. The display device 13 displays an image based on the display data supplied from the computer unit 12. For example, the currently selected tone color name is displayed.
  • LCD liquid crystal display
  • the storage device 14 is composed of a large-capacity nonvolatile recording medium such as an HDD, FDD, CD, or DVD, and a drive unit corresponding to each recording medium.
  • the external interface unit 15 includes a connection terminal that enables the electronic piano UP to be connected to an external device such as another electronic music device or a personal computer.
  • the electronic piano UP can be connected to a communication network such as a LAN (Local Area Network) or the Internet via the external interface unit 15.
  • LAN Local Area Network
  • the sound source unit 16 is connected to a waveform memory WM that stores a plurality of waveform data.
  • a waveform memory WM that stores a plurality of waveform data.
  • each sample value obtained by stereo-sampling a performance sound (single note) generated when each key of the acoustic grand piano is pressed at a predetermined sampling period (1/44100 seconds) is sampled.
  • Each channel (left channel and right channel) is stored in the waveform memory WM as waveform data.
  • a left channel microphone and a right channel microphone are respectively installed at the left end and the right end of the front end portion on the upper side of the acoustic grand piano sound board, and the acoustic signal output from each microphone is sampled.
  • the sound source unit 16 includes a reproduction unit PL and a musical tone signal processing device PP as shown in FIG.
  • the reproduction unit PL reads a plurality of waveform data from the waveform memory WM based on the tone information supplied from the CPU 12a, generates a plurality of digital tone signals, and supplies them to the tone signal processing apparatus PP.
  • the playback unit PL supplies two channels of digital music signals (a digital music signal L for the left channel and a digital music signal R for the right channel) based on the music information.
  • the musical tone signal processing device PP generates a musical tone signal representing a musical tone emitted from a virtual sound source arranged behind the speaker SP x based on the digital musical tone signal L and the digital musical tone signal R acquired from the reproducing unit PL. .
  • a soundboard SB of an acoustic grand piano is virtually arranged behind the electronic piano UP.
  • the acoustic grand piano soundboard is known to have multiple vibration modes (Fletcher, NH, Losing, TD, Kishi Kenshi, Kubota Hidemi, Yoshikawa Shigeru, “Physics of musical instruments” Science, Maruzen Publishing Co., Ltd., October 2002, p.380-p.381).
  • the characteristics of each vibration mode of the soundboard SB conform to the characteristics of each vibration mode of the soundboard of the acoustic grand piano.
  • each vibration mode of the acoustic grand piano soundboard is obtained by, for example, vibrating the acoustic grand piano soundboard with a vibrator and measuring the amplitude and phase of each part of the soundboard at each vibration frequency. It can.
  • the vibration form means the position, amplitude, phase, and the like of vibration nodes and antinodes.
  • the area SB A corresponding to the column "P" or “N” is written is an antinode of vibration.
  • “P” and “N” represent phases. That is, the phase of the region SB A corresponding to the column in which “N” is described is 180 ° behind the phase of the region SB A corresponding to the column in which “P” is described.
  • the area SB A corresponding to the column "0" is written is a node of the vibration.
  • this region SB A does not vibrate.
  • the number of vibration modes is “12”, but the number of vibration modes may be changed according to the characteristics of the acoustic grand piano to be simulated.
  • the band pass filter BP n, k corresponds to the vibration mode VM k of the soundboard SB.
  • Each bandpass filter BP n, k passes only the frequency components included in a specific frequency band among the frequency components of the musical sound represented by the digital musical tone signal supplied from the distribution unit DV.
  • the vibration of each part in each vibration mode of the soundboard SB is regarded as a lumped parameter system.
  • the vibration of the soundboard SB is equivalent to the vibration of two mass points supported via a spring and a damper.
  • the order of the transfer function of each bandpass filter BP n, k is “2”.
  • the delay unit DL n, k outputs one or a plurality of delayed signals obtained by delaying the signal supplied from the bandpass filter BP n, k .
  • the delay time of the delay signal is set according to the delay table TD1 and the delay table TD2 shown in FIGS. 7 and 8, respectively.
  • Delay table TD1 represents the delay time corresponding to the distance (distance in the longitudinal direction) between the speaker SP x of each area SB A and the electronic piano UP. Note that the positions in the front-rear direction of all the speakers SP x are considered to be the same.
  • the delay table TD1 is composed of a plurality of delay time sets DTS p .
  • a plurality of delay time sets DTS p 1, 2 ,.
  • each delay time set DTS p the longer the delay time is set in the region located on the rear side.
  • the vibration of the region SB A in the reverse phase (“N” in FIG. 6) in the vibration mode VM k is the time corresponding to the half wavelength with respect to the vibration of the region SB A in the positive phase (“P” in FIG. 6). It can be regarded as being delayed.
  • the delay table TD2 is composed of data representing a delay time corresponding to a half wavelength in each vibration mode VM k .
  • the delay time T2 to be determined is determined.
  • the delay time T2 is “0”.
  • the buffer BF n, k outputs the output signal of the delay unit DL n, k as it is.
  • a digital musical tone signal obtained by stereo sampling of a performance sound (single tone) of an acoustic piano is reproduced.
  • components in a predetermined frequency band around the natural frequency of each vibration mode of each region SB A of virtually arranged soundboard SB behind the casing of the electronic piano UP are extracted respectively.
  • the extracted frequency components are delayed and added in accordance with the arrangement position of each region SB A (that is, the distance between the region SB A and the speaker SP x ) and the phase characteristics.
  • the tone signal processing apparatus PP that generates the tone signal as described above is composed of relatively simple components such as the bandpass filter BP n, k and the delay unit DL n, k . That is, expensive hardware and complicated software are unnecessary.
  • the present invention is applied to an electronic piano, but can also be applied to other electronic musical instruments.
  • the present invention may be applied to an electronic musical instrument that simulates a harpsichord.
  • the present invention can be used to simulate an acoustic grand piano having a large dimension in the front-rear direction (for example, 2.75 m) in a grand piano type electronic piano having a relatively small dimension in the front-rear direction (for example, 1.49 m). Is also suitable. That is, a state is assumed in which a virtual soundboard is extended further rearward than the rear end portion of the electronic piano.
  • the speaker of this electronic piano is placed at a position some distance away from the performer in the front-rear direction, the distance between the performer and the speaker before the sound emitted from the speaker reaches the performer. It takes time to respond. Therefore, the musical sound signal is delayed according to the distance between the virtual soundboard region (virtual sound source) located behind the speaker and the speaker, and the vibration form of the virtual soundboard region. Just do it. Thereby, an acoustic grand piano having a large size in the front-rear direction can be simulated in a grand piano type electronic piano having a relatively small size in the front-rear direction.
  • the virtual soundboard region virtual sound source
  • the number, orientation, and arrangement of the speakers SP x of the electronic piano UP are not limited to the above embodiment.
  • a pair of left and right speakers may be provided like a normal electronic piano.
  • sound is produced using a soundboard and a plurality of actuators attached to the soundboard and vibrating a part of the soundboard. It may be generated.
  • a digital musical tone signal may be supplied from an external device (sound source device, personal computer, etc.) connected to the external interface unit 15 to the distribution unit DV.
  • an external device sound source device, personal computer, etc.
  • the performance operator and the reproduction unit PL are deleted from the above embodiment, a musical sound reproducing apparatus that reproduces musical sounds is realized.
  • each sample value obtained by sampling a performance sound (single note) at a predetermined sampling period (1/44100 seconds) is stored in the waveform memory WM as waveform data for each sampling channel.
  • Is supplied to the signal processing unit DG n 1,2 .
  • the present invention is not limited to such a form, and any signal may be used as long as it outputs a signal representing a musical sound of an acoustic instrument synthesized according to a predetermined musical sound synthesis algorithm.
  • an FM sound source or a physical model sound source may be used.
  • the audio signal is not limited to a general sound source unit, and a recorded audio signal such as CD, DVD, Blu-ray (Blu-ray is a registered trademark) may be used.
  • the sound emitted from the sound source virtually arrange

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

L'invention concerne un dispositif de traitement de signaux audio qui est destiné à un dispositif comprenant un haut-parleur et qui génère un signal audio représentant un son émis par une source sonore virtuelle qui est disposée virtuellement dans une position différente de celle du haut-parleur, ledit dispositif de traitement de signaux audio comprenant : un moyen d'acquisition permettant d'acquérir un signal d'origine représentant un son émis par un corps sonore d'un dispositif prescrit ; une pluralité de filtres passe-bande disposés en correspondance avec une pluralité de fréquences naturelles de la source sonore virtuelle, chacun des filtres passe-bande extrayant une composante fréquentielle du signal d'origine ; une pluralité de moyens de retard disposés en correspondance avec la pluralité de fréquences naturelles de la source sonore virtuelle, le moyen de temporisation temporisant les composantes fréquentielles extraites en fonction de l'état de vibration de la source sonore virtuelle et de la distance entre la position du haut-parleur et la position de la source sonore virtuelle ; et un moyen d'addition permettant d'additionner les composantes fréquentielles respectivement émises par la pluralité de moyens de temporisation.
PCT/JP2017/004682 2016-02-12 2017-02-09 Dispositif de traitement de signaux audio, dispositif de lecture audio et instrument de musique électronique Ceased WO2017138596A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-024600 2016-02-12
JP2016024600A JP2017142422A (ja) 2016-02-12 2016-02-12 音響信号処理装置、音響再生装置及び電子楽器

Publications (1)

Publication Number Publication Date
WO2017138596A1 true WO2017138596A1 (fr) 2017-08-17

Family

ID=59563162

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/004682 Ceased WO2017138596A1 (fr) 2016-02-12 2017-02-09 Dispositif de traitement de signaux audio, dispositif de lecture audio et instrument de musique électronique

Country Status (2)

Country Link
JP (1) JP2017142422A (fr)
WO (1) WO2017138596A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI681324B (zh) * 2018-09-05 2020-01-01 友達光電股份有限公司 互動式揚聲面板及其方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08190375A (ja) * 1995-01-12 1996-07-23 Matsushita Electric Ind Co Ltd 電子楽器
JP2003316358A (ja) * 2002-04-22 2003-11-07 Yamaha Corp 多チャンネル録音再生方法、録音装置、及び再生装置
JP2007183349A (ja) * 2006-01-05 2007-07-19 Yamaha Corp 電子楽器
JP2007333813A (ja) * 2006-06-12 2007-12-27 Sony Corp 電子ピアノ装置、電子ピアノの音場合成方法及び電子ピアノの音場合成プログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08190375A (ja) * 1995-01-12 1996-07-23 Matsushita Electric Ind Co Ltd 電子楽器
JP2003316358A (ja) * 2002-04-22 2003-11-07 Yamaha Corp 多チャンネル録音再生方法、録音装置、及び再生装置
JP2007183349A (ja) * 2006-01-05 2007-07-19 Yamaha Corp 電子楽器
JP2007333813A (ja) * 2006-06-12 2007-12-27 Sony Corp 電子ピアノ装置、電子ピアノの音場合成方法及び電子ピアノの音場合成プログラム

Also Published As

Publication number Publication date
JP2017142422A (ja) 2017-08-17

Similar Documents

Publication Publication Date Title
US7745719B2 (en) Electronic keyboard musical instrument
JP6878966B2 (ja) 電子楽器、発音制御方法およびプログラム
JP6805060B2 (ja) 共鳴音制御装置及び共鳴音の定位制御方法
JP4735662B2 (ja) 電子鍵盤楽器
JP2009003273A (ja) 電子鍵盤楽器
US8901408B2 (en) Electronic keyboard musical instrument
JP2017142422A (ja) 音響信号処理装置、音響再生装置及び電子楽器
JPH08190375A (ja) 電子楽器
JP2003208182A (ja) 楽音発生装置
JP4578108B2 (ja) 電子楽器の共鳴音発生装置、電子楽器の共鳴音発生方法、コンピュータプログラム及び記録媒体
JP4201153B2 (ja) 電子楽器の共鳴音発生装置
JP2001209376A (ja) 電子楽器の共鳴音発生装置
JP2008299082A (ja) 響板付き電子鍵盤楽器
JP4816678B2 (ja) 電子鍵盤楽器
JP2017032651A (ja) 楽音信号処理装置、楽音再生装置及び電子楽器
JP6524837B2 (ja) 楽器
JPH0850479A (ja) 電子楽器
JPH0621095U (ja) 電子鍵盤楽器の音場再生装置
JP2008299081A (ja) 響板付き電子楽器
JP2008298991A (ja) 電子鍵盤楽器
JP3048206B2 (ja) 電子楽器の音響装置
JP2017167323A (ja) 電子楽器
WO2024185736A1 (fr) Procédé de génération de données sonores
JPH0863154A (ja) 定位移動感再現機能を有する電子楽器
JP4735661B2 (ja) 電子鍵盤楽器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17750317

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17750317

Country of ref document: EP

Kind code of ref document: A1