JPH03216767A - Picture forming device - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed description of the invention] The present invention will be explained in the following order.

A. Industrial field of application B. Overview of the invention C. Conventional technology D. Problem to be solved by the invention E. Means for solving the problem (Fig. 1) F. Effect (Fig. 1)
Figure) G Embodiment (G1) First embodiment (Figures 1 to 3) (G2) Other embodiments H Effects of the invention It can be applied to animation creation device 1 by B Summary of the Invention The first invention is an image creation device that generates synthesis parameters based on externally input parameters and parameters stored in the main memory, and transforms the input image based on the synthesis parameters. , you can create videos in real time.

Furthermore, a second invention provides an image creation device that uses MIDI
By generating parameters according to the signal, transforming the input image, and outputting a synthesized sound, it is possible to generate a video in real time by connecting a performance device that outputs MIDI signals to the image creation device. .

C. PRIOR TECHNOLOGY In the past, an animation creation device using computer graphics has been proposed that creates a moving image using shape data representing the basic shape of each part of a character (Japanese Patent Application Laid-Open No. 1983-1989). 26584).

In this animation device, a single image is formed by transforming shape data of each part input in advance based on predetermined parameters, and then combining the transformed images.

Therefore, by setting the relevant parameters so that the synthesized image exhibits the desired change, it is possible to easily create a moving image. Problems to be Solved by the Invention In this type of animation device, there is a problem in that it is difficult to create a moving image exhibiting desired changes in real time.

In other words, in order to create a video with the desired movement, it is necessary to set the parameters once, check the movement, and then repeat the correction work. Therefore, for example, when displaying a video that changes according to a keyboard performance, it is possible to display a video that appears to change in real time by setting parameters over time during a scheduled performance. However, there was a problem in that it was not possible to display videos that followed the performance during unplanned improvisational parts, making it impossible to apply in the end.

The present invention has been made in consideration of the above points, and it is an object of the present invention to propose an image creation device that can create a moving image exhibiting desired changes in real time.

E Means for Solving the Problem In order to solve the problem, in the first invention, the input image memory 2 that stores the input image and the parameters Q, R, and S that specify the transformation of the input image are sequentially changed. Main memories A, B, and C are stored in time series, and parameters RQ. ．． R.R.
．． Parameter input means 2 for inputting RS in real time
0, 26, parameters Q, R, S stored in the main memories A, B, C and parameters R. Adding means l2A for adding Q, RR, and RS at a predetermined ratio and outputting a synthesis parameter;
12B, 12G, 14A, 14B, 14C, 28A, 2
8B, 28C, an image processing means lO that deforms the input image stored in the input image memory 2 according to the synthesis parameters and generates a deformed image, an output image memory 16 that stores the deformed image, and an output image memory 16. a display means 6 for displaying the deformed image stored in the buffer memory 32A, 32B, 32C for storing the synthesis parameters; Transfer and main memory A, B, C
and a synthesis parameter transfer means 4 for storing the synthesis parameters as parameters Q, R, and S.

Furthermore, in the second invention, an input image memory 2 that stores input images, and a MIDI signal S. MIDI that outputs
The signal generating means 20 and the MIDI signal S. Synthetic sound generating means 22 and 24 generate synthetic sounds according to the MIDI signal S. a parameter generating means 26 that generates parameters RQ, RR, and RS for specifying transformation of the input image in accordance with the input image memory 2; The image processing apparatus is provided with an image processing means 10 for generating a deformed image, an output image memory 16 for storing the deformed image, and a display means 6 for displaying the deformed image stored in the output image memory l6. Parameters Q1R, S stored in F action main memory A, BXC
Then, if a synthesis parameter is generated based on the parameters RQ, RR, and RS inputted via the parameter input means 20 and 26, and the input image is transformed based on the synthesis parameter, the parameter input means 20 and 26 are It is possible to display in real time a moving image that undergoes desired changes through manipulation.

Furthermore, MIDI signal S. If a synthesized sound is generated according to the performance, parameters RQSRR and RS are generated, and the human image is transformed, a desired performance means that outputs the MIDI signal S4 can be connected, and a moving image that changes according to the performance can be created in real time. It can be displayed in

G example An embodiment of the present invention will be described in detail below with reference to the drawings.

(G1) First Embodiment In FIG. 1, 1 indicates an animation device as a whole, which creates moving images in real time. Therefore, in the animation device 1, basic shape data of the character obtained through the imaging means is stored in the input image memory 2.

That is, as shown in FIGS. 2 and 3, the input image memory 2 stores three basic shapes related to the movement of the character's feet (FIG. 2 (A), (B), and (C)) and the character The three basic shapes related to arm movements (Figure 3 (A)
), (B) and (C)).

Correspondingly, the parameter memory 4 stores a parameter Q related to leg movement, a parameter R related to arm movement, and a parameter S related to the display position of the character in memories A, B, and C, respectively.

These parameters Q, R and S are sequentially set on the time axis (hours, minutes,
seconds, expressed based on the frame number) and stored in the memories A, B, and C, respectively, and the shape stored in the input image memory 2 is transformed and synthesized according to the parameters Q, R, and S. However, it is possible to display characters with desired movements.

Therefore, in memory A that stores parameter Q,
First, the operator specifies desired times T3, T8, and Tc, and the shape of the character's feet displayed on the monitor 6 is
By specifying the shape of the foot stored in the input image memory 2 at the times T3, T8 and TC (Fig. 2 (A), (B> and (C)), the shapes at the times T3, T8 and TC are specified. Parameter Q with values A3, A8, and Ac is stored in Tc.

Furthermore, the value A3 of the parameter Q at times T3, T8, and Tc
, A8 and Ac, the values a1,
a2, a4~a7, a9~ab, ad, ae,...
The parameter Q of ... is generated, and the time T3, T8 and T
It is assigned to the time before and after c. Similarly, in the memory B that stores the parameter R, the operator specifies desired times T1, T8, and Te, and the shape of the character's arm displayed on the monitor 6 is displayed in the input image memory at the relevant times T1, T8, and Te. By specifying the arm shape stored in 2 (Fig. 3 (A), (B), and (C)), the parameters R of values B1, B8, and Be are set at the relevant times T1, T8, and Te. is stored. Further, the value B1 of the parameter R at times T1, T8 and Te,
From B8 and Be, the values b2 to b are obtained using the interpolation method.
Parameters R of 7, b9 to bd, . . . are generated and assigned to times T1, T8, and times before and after Te.

On the other hand, in the memory C that stores the parameter S, the operator specifies desired times T4, T7, and Tc, and specifies the display position of the character to be displayed on the monitor 6 at the times T4, T7, and Tc. , the relevant time T
4, parameter S with values C4, C7, and Cc is stored in T7 and Tc. Furthermore, the value C4 of the parameter S at times T4, T7, and Tc
, C7 and Cc, using the interpolation calculation method, ite value c1 ~
c3, c5, c6, c8~cb, cd, ce,...
... parameters S are generated, and the parameters S are generated at times T4, T7 and T.
It is assigned to the time before and after c. Each image conversion processing device 10 has a weighting circuit 12A.
, 12B and 12G and addition circuits 14A, 14B and 14
Parameters Q, R and S are input via C, with the parameters Q, R and S being input in the order assigned to the time axis.

Furthermore, the image conversion processing device 10 manually processes the shape data stored in the input image memory 2 and transforms the shape of each part of the character represented by the shape data according to the values of the parameters Q, R, and S. That is, the image conversion processing device 1
0, the character's feet are deformed as if the character is walking, gradually deformed at times T1 and T2, and then stored in the input image memory 2 at time T3 (Fig. 2 (A).
)) Transform the image to match. Further, the image is gradually deformed from time T3 to T7, and at time T8, the image is deformed so as to match the shape stored in the input image memory 2 (FIG. 2(B)). On the other hand, the character's arm is deformed so that it swings, and after matching the shape stored in the input image memory 2 at time TI (FIG. 3(A)), the character's arm is deformed so that it swings.
The shape changes gradually over time T8, and at time T8, the shape is transformed so as to match the shape stored in the input image memory 2 (FIG. 3(B)). Furthermore, the image conversion processing device 10
1. After forming the overall shape of the character by combining the shapes of the legs and arms that have been deformed in T2..., the overall shape of the formed character is placed at a position determined by the parameter S. The output image memory 16 temporarily stores the image generated by the image conversion processing device 10, converts it into a video signal, and outputs the video signal to the monitor 6.

This allows the monitor 6 to display a moving image exhibiting changes preset by the operator. The keyboard 20 has an MID I (susica
l instrument digital inte
rface) standard signal (hereinafter referred to as MlDI signal) S
l1 to the sound source 22, and thereby the keyboard 2
A synthesized sound is output from the speaker 24 in response to the key press operation.

The filter 26 is composed of an arithmetic processing circuit, and detects the scale, strength, and length of the synthesized sound output from the speaker 24 based on the MIDI signal SN, and based on the detection results, three parameters RQ, RR. and generate RS. At this time, the filter 26 generates the parameters RQ, RR, and RS at a period that matches the time axis of the parameters Q, R, and S stored in the memories A, B, and C, and outputs them to the weighting circuits 28A, 28B, and 28C. .

Furthermore, at this time, the filter 26 has a parameter Q
, R and S are generated so that their values change within a range corresponding to R and S.

As a result, in the weighting circuits 28A, 28B and 28C, when the performance of the keyboard 2o starts, the values AIX, A2X, . . . , BIX, B2X,
...and the parameters RQ, RR and RS of CIX, C2X, ......, and the parameters Q1R and S
It is designed so that it can be input correspondingly. On the other hand, the coefficient control section 30 receives the control signal SCOe output from the keyboard 2o in response to the player's operation of the keyboard 20, and controls the weighting circuits 12A, 12B, 12C and 12C according to the control signal Scowl. 28A, 2
Values K1, K3, K5 and K2 for 8B and 28C, respectively.
Output the weighting coefficients of K4 and K6. Weighting circuits 12A, 12B, 12C and 28A, 28
B and 28C are parameters Q according to the weighting coefficients.
, RSS, RQSRR and RS are weighted. Adding circuits 14A, 14BS and 14C add the weighting processing results of weighting circuits 12A and 28A, 12B and 28B, 12C and 28C, respectively, and output the result to image conversion processing device 10. As a result, in the image conversion processing device 10, when playing the keyboard 20, instead of the parameters Q1R and S, a composite parameter obtained by combining the parameters Q, R, and S with the parameters RQ, RR, and RS is input, The shape of the character stored in the input image memory 2 is transformed based on the synthesis parameters. Therefore, in the image conversion processing device 10, the coefficient control section 3
Keyboard 2 according to the weighting coefficient output from 0
It is possible to obtain a synthesis parameter whose value changes in accordance with the performance of the keyboard 20, and by deforming the shape of the character and forming a moving image based on the synthesis parameters, it is possible to obtain a synthesis parameter whose value changes according to the performance of the keyboard 20. You can get videos that change depending on the image. Furthermore, by switching the weighting coefficients at this time, a moving image that follows the performance of the keyboard 20 can be formed based on the movements set in advance in the memories ASB, C, or, conversely, a motion that follows the performance of the keyboard 20 can be created. It is possible to create a moving image that exhibits the movements set in the memories A, B, and C in advance, and to expand the expression format of the moving image.

Furthermore, at this time, in the animation device 1,
Since the parameters RQ, RR and RS are generated based on the MIDI signal Sκ, the MIDI
It is possible to connect a rhythm machine, etc. that can output a DI signal S, and further, to output a synthesized sound and create a moving image by connecting an arithmetic processing unit. Therefore, the usability of the animation device 1 can be improved accordingly. Furthermore, in this embodiment, the buffer memory 32A,
Addition circuits 14A, 14B, 1 are added to 32B and 32C, respectively.
Stores the synthesis parameters output from 4c, and stores the synthesis parameters output from memory A.
, B, C can be replaced with the synthesis parameters stored in the buffer memories 32A, 32B, 32C as needed. This allows the operator to check the motion of the moving image via the monitor 6 and store the synthesis parameters used to generate the moving image when deemed necessary. Therefore, by updating the contents of memos IJA, B, and C, it is possible to reproduce an improvised video. In addition, it can be applied to video correction work as needed to simplify the correction work. Thus, in this embodiment, input image memory 2 constitutes an input image memory for storing input images, whereas memories A, B, and C store parameters Q, R, S,
Configure main memory that stores data in sequential time series. Furthermore, the keyboard 20 receives MIDI signals S. The filter 26 constitutes a MIDI signal generating means for outputting the MIDI signal.
DI signal S. The keyboard 20 and the filter 26
constitutes a parameter input means for inputting parameters RQ, RR, and RS in real time.

On the other hand, weighting circuits 12A, 12B, 12C, 2
8A, 28B, 28C and adder circuits 14A, 14B, 1
4C is the parameter Q stored in main memory A, BSC
. An image processing means is configured to transform the stored input image according to the synthesis parameters and generate a transformed image.

Further, the output image memory 16 forms an output image memory for storing a deformed image, the monitor 6 forms a 1,000-stage display 6 for displaying the deformed image stored in the output image memory 16, and the parameter memory 4 forms an output image memory for storing a deformed image. , 32G are transferred to the main memories ASB, C, and the synthesis parameters are stored as parameters Q, R, S in the main memories A, BSC.

In the above configuration, the basic shape data of the character obtained through the side image means is first stored in the input image memory 2.

Furthermore, by specifying the time and the shape of each part of the character, the operator can set the parameters Q, R, and S that represent the shape of the character's legs, arms, and display position of the character.
are allocated to the time axis and stored in memories A, B, and C, respectively. After this preliminary processing, when the performer plays the keyboard 20, the parameters RQ, RR, and RS corresponding to the parameters Q, R, and S are sequentially filtered through the filter 26 based on the MIDI signal S4 output from the keyboard 20. are generated and weighted by weighting circuits 28A, 28B, and 28C in response to the player's operations. Parameter Q stored in memories A, B and C at the same time,
R and S are weighted by weighting circuits 12A, 12B, and 12C, respectively.
The weighting processing results of A, 12B and 28B, 12C and 28C are added by addition circuits 14A, 14B and 14C.

As a result, via the adder circuits 14A, 14B, and 14C,
It is possible to obtain a synthesis parameter whose value changes in accordance with the performance of the keyboard 20, and based on the synthesis parameter, the basic shape of each part of the character stored in the input image memory 2 is determined by the image conversion processing device 10''? :!Transformed.

The shape of each part of the character that has undergone the deformation processing is combined by the image conversion processing device 10 to generate the overall shape of the character, and then placed at a display position determined by the parameter S, so that it can follow the operation of the keyboard 20. You can get videos that change in real time.

The image generated by the image conversion processing device IO is displayed on the monitor 6 via the output image memory 16, and at this time, the synthesized sound generated by the sound source 22 is output via the speaker 24, and thus the keyboard 20 is It is possible to display videos that follow the performance in real time.

At this time, in the synthesis parameters, the buffer memory 3
After being stored in 2A, 32B, and 32G, the parameter Q is stored in memories A, B, and C as necessary.
It is designed to be replaced with SR and S, which makes it possible to reproduce videos and simplify video editing work. According to the above configuration, the synthesis parameters are generated based on the parameters Q, R, S set in the memories ASB, C and the parameters RQ, RR, RS generated in response to the operation of the keyboard 20. By deforming the input image based on the synthesis parameters, the keyboard 2
You can create a video that changes in real time by following the performance of 0.

Furthermore, the MIDI output from the keyboard 20 at this time
By generating the parameters RQ, RR, and RS based on the signals, the parameters RQ, RR, and RS can be input using a performance means other than the keyboard as necessary, and further using an input means such as an enka processing device. Therefore, the usability of the animation device can be improved.

(G2) Other Embodiments Although the above-mentioned embodiment describes the case where parameters are generated based on MIDI signals, the present invention is not limited to this, and can be widely applied to various signals other than MIDI signals. I can do it.

In this case, for example, by generating parameters based on input signals from a digitizer, mouse, etc., it is possible to create a moving image that changes in response to the operation of the digitizer, mouse, etc.

Furthermore, if parameters are generated using natural sounds recorded on a tape recorder or the like, it is possible to create a moving image that changes according to the natural sounds.

Furthermore, in the above embodiment, the character's legs, arms,
Although the case where a moving image is formed by specifying the display position with a parameter has been described, the present invention is not limited to this, and the present invention is not limited to this. It can be widely applied when changing the .

Effects of the Invention H As described above, according to the first invention, synthesis parameters are generated based on preset parameters and parameters input via the parameter input means, and the input image is generated based on the synthesis parameters. By performing the transformation process, it is possible to obtain an image creation device that can display a moving image exhibiting a desired change in real time by operating the parameter input means.

Furthermore, according to the second invention, by generating a synthesized sound according to the MIDI signal, generating parameters, and transforming the input image, it is possible to connect a desired performance means that outputs the MIDI signal and create a moving image in real time. It is possible to obtain an image creation device that can be displayed using .

[Brief explanation of drawings]

FIG. 1 is a block diagram showing an animation device according to an embodiment of the present invention, and FIGS. 2 and 3 are route maps showing input images. ■... Animation device, 2... Input image memory, 4... Parameter memory, 6.
...Monitor, 10...Image conversion processing device, 12A, 12B, 12C, 28A, 28B, 28C.
...Weighting circuit, 14A, 14B, 14C...
...Addition circuit, 16...Output image memory,
20...Keyboard, 22...Sound source,
24...Subika, 26...Filter, 32A, 32B, 32C...Buffer memory, A, B, C...Memory.

Claims (2)

[Claims] (1) an input image memory that stores an input image; a main memory that stores parameters specifying the transformation of the input image sequentially in chronological order; and a parameter input means that inputs the parameters in real time; adding means for adding the stored parameters and the parameters input via the parameter input means at a predetermined ratio and outputting a synthesis parameter; an image processing means for generating a deformed image by deforming the deformed image according to the deformed image; an output image memory for storing the deformed image; a display means for displaying the deformed image stored in the output image memory; and a display means for storing the composition parameter. and a composition parameter transfer means for transferring the composition parameters stored in the buffer memory to the main memory and storing the composition parameters as the parameters in the main memory. Creation device. (2) Input image memory that stores input images and MIDI
MIDI signal generating means for outputting a signal; synthetic sound generating means for generating a synthesized sound according to the MIDI signal; parameter generating means for generating a parameter specifying transformation of the input image according to the MIDI signal. an image processing means for deforming the input image stored in the input image memory according to the parameters to generate a deformed image; an output image memory for storing the deformed image; and display means for displaying the modified image.