JPH04129062A - Video and audio simultaneous output device - Google Patents

Abstract

PURPOSE:To automatically output synchronized sounds by extracting the change of recorded picture and generating a control instruction for the reproduced output of recorded sounds based on this change to reproduce and output the audio output. CONSTITUTION:For example, the picture of a sciene where firewroks to up in the background and a person exists in front of them is outputted from a video recording and reproducing part 1. A video change extracting part 2 extracts a feature quantity like brightness L of a preliminarily set extraction area A of the picture ad sends it to an audio output control part 3. When the feature quantity (L2-L1) of the extracted picture change exceeds a certain threshold Lsigma, the audio output control part 3 judges exposing of fireworks to send the control part 3 judges explosion of fireworks to send the control instruction of the start of reproducing of fireworks explosion sounds to a sound recording and reproducing part 4, and recorded fireworks explosion sounds like a boom are reproduced and outputted in accordance with this control instruction sent to the sound recording and reproducing part 4. Thus, sounds synchronized with pictures are automatically outputted in real time in accordance with the change of the output picture.

Description

[Detailed description of the invention] 〔table of contents〕 overview Industrial applications Conventional technology (Figure 23) Problems that the invention aims to solve Means to solve the problem (Figure 1) action Example First embodiment (Figures 2 to 9) Second embodiment (Figures 10 to 15) Third embodiment (Figures 16 to 21) Fourth embodiment (Figure 22) Effect of the invention 〔overview〕 The present invention relates to a video and audio synchronous output device.

When playing a video, extract changes in the video.

The purpose is to synchronously output the corresponding audio according to the video change state.

A video recording and reproducing means for reproducing and outputting a recorded video, a video change extracting means for extracting a change in the output video, and a control command for reproducing and outputting the recorded audio based on the change in the video. an audio output control means for generating;
The apparatus includes an audio recording/reproducing means for reproducing and outputting an audio output based on the control command.

The system is configured to automatically output synchronized audio in response to changes in recorded video output.

[Industrial application field]

The present invention is applicable to video that is digitally reproduced in a video editing device or a computer interface, which is a device part for human operation of a computer (such as a work stage or personal computer).

The present invention relates to a device that automatically synchronously outputs prerecorded audio information.

[Conventional technology]

Creating a video or animation (2) When playing video and audio, the audio is also recorded at the same time (=recording and playing it back, or creating only the video and later doing what is called dubbing). In particular, there are ways to complete a work by collecting, editing and compositing animation footage obtained from video shooting or computer creation, or by creating a work by editing and composing the images. When using it as an interface 1 It is very useful to assign appropriate audio and sound to the created video afterwards, as it increases the sense of realism and the compatibility of the interface. Technology is needed to output images in synchronization with the images.

Conventional video editing systems such as dubbing and computer interfaces cannot synchronize audio with video.

A method has been used in which a synchronization list is created manually in advance, and then the synchronization control section synchronizes the video output and the audio output while referring to the synchronization list.

The conventional technique will be explained with reference to FIG.

Figure 23 shows the configuration of a conventional video and audio editing device. In the figure, 81 is an operator, 82 is a synchronization list, and instructions such as which audio to play in which frame of the video are manually given. This is what I created.

Reference numeral 83 denotes a synchronization control section, which controls the operations of a video recording and reproducing section 84 and an audio recording and reproducing section 86, which will be described later, based on information obtained from the synchronization table 82.

The video recording and reproducing section 84 stores the video shot or created in advance in a file 85, and controls the synchronization control section 83 (= means that the audio recording and reproducing section 8 outputs the stored video.
Reference numeral 6 outputs the audio recorded in advance in the audio file 87 under the control of the synchronization control section 83.

Conventionally, the operator 81 manually prepares in advance a synchronization/period=list 82 of, for example, the number of video frames and the audio to be output, and controls the synchronization of the video and audio based on this synchronization list.

The synchronization control unit 83 of the editing device constantly monitors the number of frames that the video recording and reproducing unit 84 outputs the video recorded in the file 85, and synchronizes with the number of video frames by referring to the synchronization list 82. A control signal is sent to the audio recording and reproducing section 86 to output audio.

Based on this control signal, the audio recording and reproducing section 86 outputs the audio recorded in the audio file 87, and the video or animation script is edited.

[Problem to be solved by the invention]

However, in this conventional editing device, setting the synchronization list requires manual work in advance, and therefore it is not possible to synchronize in real time during video playback. In other words, audio that is synchronized with the video.

Since the synchronization list is determined in advance at the stage of creating the synchronization list, it is not possible to dynamically select and output various sounds according to the video.

Therefore, an object of the present invention is to automatically add various audio signals to recorded video without manually inputting a synchronization signal in advance, and to add audio signals from among multiple audio signals according to changes in the reproduced video. To provide a device that can select and synchronously output audio suitable for the selected audio at a given time.

[Means to solve the problem]

FIG. 1 is a diagram illustrating the inventive principle of the present invention.

FIG. 1(a) is a block diagram of the configuration of the video/audio synchronous output device of the present invention, and FIG. 1(b) is an explanatory diagram of its operation.

In No. 11!4(a), 1 is a video recording and reproducing unit, which reproduces recorded video.

Reference numeral 2 denotes a video change extraction section, which is connected to the video recording and reproducing section 1 and extracts changes in the output video.

Reference numeral 3 denotes an audio output control unit, which is connected to the video change extraction unit 2 and generates a control command for audio output based on the change in the video image; 4 is an audio recording and reproducing unit, which is connected to the video change extraction unit 2; Audio output is started in synchronization with a control command from the control unit 3, and it may be a file, a tape recorder, or a CD as long as it can automatically synchronize.

The present invention will be described with reference to an example in which the video recording and reproducing section 1 outputs a video of a scene where fireworks are going off in the background and there are people in front of them, as shown in FIG. 1(b), for example.

This video is output to a video output section (not shown) and also to the video change extraction section 2.

The image change extracting section 2 extracts a feature amount 2 of the image in a preset extraction area size, for example, brightness L, and sends this to the audio output control section 3.

That is, when the image changes from screen I to screen I in Figure 1 (b3), the brightness of extraction area A in screen I in Figure 1 (b) is Ll, and the brightness of extraction area A in screen ■ is If L2, the image change extraction unit 2 extracts the change state (Lx −Ll)
is extracted and sent to the audio output control section 3.

The audio output control unit 3 generates a control command based on the sent feature amount, and sends it to the audio recording and reproducing unit 4.

That is, when the extracted feature amount (L2-Ll) of the image change becomes larger than a certain threshold value Le, the audio output control unit 3 determines that "fireworks have exploded" and "plays fireworks explosion sound." A control command "Start" is sent to the audio recording/reproducing section 4.

The audio recording/reproducing section 4 reproduces and outputs the recorded audio 2, for example, a "fireworks explosion sound" called "tone" in accordance with the sent control command.

[Effect]

As described above, by using the video/audio synchronized output device of the present invention, it is possible to output audio that is automatically synchronized with the screen in real time in response to changes in the output video.

〔Example〕

(1) First Embodiment As a first embodiment of the present invention, suppose a video scene in which fireworks are set off in the background, and the case where the explosion sound of fireworks is added synchronously to this is shown in Fig. 1('b) and This will be explained with reference to FIGS. 2 to 9.

FIG. 1(b) shows an example of a video output (from the video recording and reproducing section 1 of FIG. 2, which will be described later), and represents frames of the video that change in the order of 2-screen PI and 2-screen PHI. The dotted line area in each screen indicates a predetermined feature extraction area A, and an image of fireworks appears in this extraction area A as shown in screen P■. Note that Person B in the screen represents a person shouting in front of fireworks.

FIG. 2 is a block diagram of the configuration of the video/audio synchronous output device of the present invention.

In Fig. 2, the same symbols as in Fig. 1 indicate the same parts, and 1
2 is a video recording and playback section, and 2 is a video change extraction section.

3 is an audio output control section, 4 is an audio recording and reproducing section 0 Audio output control section 3 is a video change search section 31 and a video change classification table 3
2. Control instruction generation unit 33. A voice control command table 34 is provided.

The video change classification table 32 records a list of video changes extracted by the video change extraction section 2 and classification results, as shown in FIG. 4, which will be described later.

The audio control command table 34 records classification results of the video change classification table 32 and audio control commands to the audio recording/reproducing section 4 based on the classification results, as shown in FIG. 5, which will be described later.

FIG. 3 is an explanatory diagram showing an example of synchronization of video and audio in FIG. 1(b). The horizontal axis represents time, and the arrow PI.

Pi represents a point of change in the output video of the video recording and reproducing section 1.

A rightward arrow indicates that audio is being played.

FIG. 4 is a detailed explanatory diagram showing an example of the image change classification table 32, where Ll is the brightness of the image extraction area at a certain point in time, and Ll is the brightness of the image extraction area at a certain point in time, and Ll is the brightness of the image extraction area after a certain period of time has elapsed since Ll, for example, in the next frame after Ll. Brightness of image extraction area A.

Lo is a constant representing a criterion.

FIG. 5 is a detailed explanatory diagram showing an example of the voice control command table 34.

FIG. 6 is a detailed explanatory diagram showing an example of recorded audio. FIGS. 7 to 9 are block diagrams showing the implementation of the first embodiment.

Next, in the second factor to explain the operation of synchronized output of video and audio, a video as shown in FIG. It is sent to the extraction unit 2.

The image change extraction unit 2 extracts several predefined feature quantities 2, for example, the brightness L of the extraction area A of the screen in FIG. 1(b).
The feature quantity (Lx-Lt) of the video change sent to the audio output control unit 3 is extracted and sent to the audio output control unit 3.
Ll) is first sent to the video change search section 31. The video change search unit 31 uses a video change classification table I32 as shown in FIG.
See.

In this example, the extracted feature amount (Ll-Ll) is a constant Lo
Even more so, we get the classification result "The fireworks exploded." The video change search unit 31 sends this classification result to the control command generation unit 33.The control command generation unit 33 uses the classification result to refer to the audio control command table I as shown in FIG. The audio recording and reproducing unit 4 sends a control command [Start reproducing fireworks explosion sound] to the voice recorder 4. According to the sent command, the audio recording and reproducing unit 4 reproduces and outputs the recorded audio "tone" as a fireworks explosion sound as shown in FIG. 6. As shown in Fig. 3, the explosion sound of fireworks is output in synchronization with the time when the video output screen P■ changes to the screen PII. You can also add components.

Examples of implementation aspects of these embodiments will be explained in FIGS. 7 to 9.

In the embodiment shown in FIG. 7, the audio output control section 3 is provided with a timer section 5.

Timer unit 5 is activated when there is a time difference between video and audio.

This delays the synchronization time of audio output.

When a video is output from the video recording/playback section 1, the video change extraction section 2 extracts several predefined feature amounts and sends them to the audio output control section 3.

The audio output control section 3 delays the synchronization time using the timer section 5 according to the change in each characteristic amount, and then sends a command to the audio recording/reproducing section 4. The audio recording and reproducing section 4 outputs the recorded audio according to the sent command.

As a result, audio corresponding to changes in the video is output synchronously at certain time intervals.

The embodiment shown in FIG. 8 is provided with a video storage buffer 6 between the video recording/reproducing section 1 and a video output section (not shown).

The video storage buffer 6 is a buffer for delaying video output, and for example, holds the screen while no video changes appear on the screen so that audio output is output first.

When a video is output from the video recording/playback section 1, the video storage buffer 6 stores the video for a certain period of time.

Outputs the video after a certain period of time.

On the other hand, the video change extraction section 2 extracts several prescribed feature amounts and sends them to the audio output control section 3. The audio output control unit 3 sends commands to the audio recording and reproducing unit 4 according to changes in each feature amount. The audio recording and reproducing unit 4 outputs the recorded audio according to the sent command.

Since the audio is synchronized with the video before entering the video storage buffer 6, it appears to be synchronized at a time earlier than the change in the video output, and the audio corresponding to the change in the video is output synchronously.

In the embodiment shown in FIG. 9, the audio output control section 3 is provided with a history storage section 7.

The history storage section 7 stores the history of reproduced audio.

When a video is output from the video recording and reproducing unit 1, the video change extraction unit 2 extracts a predefined feature amount 2, for example, the above (Ll
-Lt) and sends it to the audio output control section 3.

The audio output control unit 3 records changes in each feature amount and the contents 2 of the history storage unit 7, for example, “the audio is being played for the first time.”
It sends a command to the audio recording/playback unit 4 according to the current state of the audio output control unit 3.

For example, “second audio reproduction” is sent to the history storage unit 7.

The voice recording and reproducing section 4 outputs the recorded voice 9, for example, "Tamaya~" according to the sent command.

This allows audio to be output in synchronization with changes in the video.

(2) Second Embodiment As a second embodiment of the present invention, suppose a video scene in which fireworks rise and explode in the background, and add the sound of fireworks and explosion to this. This will be explained with reference to FIG.

FIG. 10 shows an example of a video output from the video recording and reproducing unit 1 in FIG. 11, which will be described later. It shows a predefined feature extraction area. Person B in the screen represents a person screaming in front of fireworks.

FIG. 11 is a block diagram of a second embodiment of the present invention.

In FIG. 11, the same reference numerals as in FIGS. 1 to 9 indicate the same parts, and 1 is a video recording and reproducing section, and 2 is a video change extraction section, which includes a first change extraction section 21. 3 is an audio output control section, which includes a video change search section 31. Image change classification table 32
．． It includes a control command generation section 33 and a voice control command table 34. Reference numeral 4 indicates an audio recording/reproducing section, 5 a timer section, and 6 a video storage buffer.

FIG. 12 is an explanatory diagram showing an example of synchronization of video and audio in FIG. 10. The horizontal axis represents time, and arrows pip2 and p3 indicate changing points of the output video of the video recording and reproducing section 1.

Arrow P1. Pz and Ps represent video change points in the video output of the video device. The rightward arrow indicates that the audio is being played back, TO is the video delay time due to the video storage buffer 7, and Tl
represents the audio delay time by the timer section 6.

FIG. 13 is a detailed explanatory diagram showing an example of the image change classification table 32, where Ll and Lx are the brightness of the image change extraction area as in FIG. 4, and Lo and Lo' are constants representing judgment criteria. Yes, L6' is slightly larger than 0.

This is a constant that is considerably smaller than Lo.

FIG. 14 is a detailed explanatory diagram showing a penny in the voice control command table 34. In FIG. 14, T1 represents the audio delay time caused by the timer section 5.

FIG. 15 is a detailed explanatory diagram showing an example of recorded audio.Next, the operation of synchronized output of video and audio will be explained.0 The video recording and reproducing section 1 in FIG. Output.

The output video p is sent to the video storage buffer 6, where the video is stored for a certain period TO.

As a result, the video gRP is output to the video device with a delay of TO (see FIG. 5).

On the other hand, the fireworks video reproduced and output by the video recording and reproducing section 1 is also sent to the video change extraction section 2 at the same time.

The first change extraction section 21 of the video change extraction section 2 extracts the brightness of the extraction area A for each screen.

For example, if the brightness of the large extraction area of the second screen p1 is the initial brightness Ll, and the brightness of the extraction area A of the screen p2 is the brightness after the change L2, then (Lx-Lt) will be extracted sequentially.Similarly, At the time of changing from screen p2 to screen p3, screen p
The brightness of extraction area A in 2 is the initial brightness Ll, screen p
The brightness of the large extraction area of 3 is Lx, (Lx - Ll)
are sequentially extracted and sent to the audio control output section 3.

In the audio output control section 3, the extracted video change is first sent to the video change search section 31. The video change search section 31 refers to the video change classification table (2) as shown in FIG. 13 provided therein.

In this example, the extracted video change (L-2-Ll) is Lo
``Fireworks were set off'' between ' and Lo.

If it is Lo or higher, the classification result is that "the fireworks exploded."

Therefore, the video change search unit 31 sends these classification results to the control command generation unit 33.The control command generation unit 33 uses the sent classification results to refer to the audio control command table 1, a detailed example of which is shown in FIG. to generate voice control commands.

As a result of referring to the control command table (■), the control command generation unit 33
Based on the classification result that “fireworks were launched”, it sends a control command to the audio recording and reproducing unit 4 to “start playing fireworks launch sound” and also sends a control command to the timer unit 5 at T1.
Set the time.

As a result, the control command generating unit 33 sends control commands to the audio recording and reproducing unit 4 to “stop reproducing fireworks launch sounds” and “start reproducing fireworks explosion sounds” after the elapse of time T1 (2).

The audio recording and reproducing unit 4 follows the sent control command.

The recorded audio is reproduced as illustrated in FIG.

That is, at the point when (Lx-L >Lo'), for example, a fireworks sound called "hieruhyuru" is played and outputted, and after T1 time has passed, this fireworks sound is stopped and a fireworks explosion sound called "tone" is emitted. Playback (See Figure 5) 0 As a result, in Figure 5, the video output of the video output section is delayed by TO from the output of the video recording and playback section 1, and at the same time, the audio is output before any change occurs on the screen P. (3) Third Example Next, synchronize the video and voice of person B screaming in front of fireworks. This will be explained with reference to FIGS. 16 to 21.

FIG. 16 shows an example of a video recorded in the video recording and reproducing section 1, and is an enlarged view of the face of person B on the screen illustrated in FIG. In FIG. 16, a face F1 is an image at a certain time, and a face F2 is an image of, for example, the next frame after a certain period of time. Also, hl and h2 are the vertical sizes of the mouth in the video, wl
, w2 is the width of the mouth in the image, and sl and s2 are the areas of the colored parts inside the mouth.

The seventeenth doctor is a configuration block diagram of a third embodiment of the present invention.

In FIG. 17, the same symbols as in FIG. 1, etc. indicate the same parts, 1 is a video recording and reproducing section, 2 is a video change extraction section,
A second change extraction section 22 is provided.

3 is an audio output control section, which includes a video change search section 31, a video change classification table 32. A control command generation unit 33 is provided with a voice control command table 34. Reference numeral 4 indicates an audio recording/reproducing section, and 7 indicates a history storage section.

FIG. 18 is an explanatory diagram showing an example of synchronization of video and audio in FIG. 16. In FIG. 18, as in FIG. 3, the horizontal axis is the time axis, the downward arrow indicates the point of change in the video, and the rightward arrow indicates the audio being played back.

FIG. 19 is a detailed explanatory diagram showing still another example of the video change classification table 32. In FIG. 19, h.

W indicates the vertical size 2 width of the mouth in the image.

81.82 indicates the area of the colored part inside the mouth, 1, 2. 3. 4 is a constant representing a judgment criterion.

FIG. 20 is a detailed explanatory diagram showing still another example of the voice control command table 34.

FIG. 21 is a detailed explanatory diagram showing still another example of recorded audio.

The operation of synchronous output of video and audio will be explained.

The video as shown in FIG. 16 is sent from the video recording and reproducing section 1 in FIG. 17 to the video output section.

It is sent to the video change extraction section 2.

The second change extraction unit 22 of the video change search unit 2 extracts the vertical size (hl, h2) of two specified feature quantities for each video,
Width (yl, vr2), area of the colored part inside the mouth ('1
* Extract '2).

The extracted feature quantity change is sent to the video change search unit 31 that constitutes the audio output control unit 3. The video change search unit 31 refers to the video change classification table (2) as shown in FIG. 19 provided therein. In the image change classification table I in FIG. 19, for example, when the aspect ratio (h/W) of the mouth size exceeds a constant kl for a certain period of time, the classification result is ``opened the mouth.''

Similarly, when the aspect ratio (h/W) of the mouth size is smaller than 3, the classification result is ``mouth closed.''

The ratio of the areas of the colored parts inside the mouth (11/$2) is a constant of 2.
When it is larger than 2, the classification result is "opened mouth", and (s
1/s2) is a constant smaller than 4, one classification result is "mouth closed" 0 For example, the classification result "open mouth" obtained from the feature extracted by the image change extraction unit 2 is sent to the control command generation section 33 via the video change search section 31.

The control command generation section 33 follows the received classification results according to the voice control command table 1, a detailed example of which is shown in FIG. 20, and the information stored in the history storage section 7.

A control command is sent to the audio recording/playback section 4 and the history storage section 7.

That is, when the classification result "opened the mouth" is sent to the control command generation unit 33 (2), if the history of "opened the mouth" is the first time, the control command "start playing audio 1" is sent to the voice recording and reproduction. section 4 and history storage section 7.

The audio recording and reproducing unit 4 follows the sent control command.

Recorded audio 2 exemplified in FIG. 21, for example, plays back "Tamaya~" On the other hand, the above control command is also sent to the history storage section 7, so
The history storage unit 7 stores this classification result of “opened mouth” as 1
FIG. 18 shows an example of synchronization of zero or more times in which the times of history are stored. That is, the sound 1 "Tama-ya~" is played at the same time as the screen where Person B opens his mouth for the first time in the device video output, the sound stops at the same time as he closes his mouth, and the sound 2 " When "Kagiya~" is played and the two doors are closed, synchronized video and audio output will be automatically performed in which the two audio stops at the same time.

(4) Fourth Embodiment Next, as a fourth embodiment of the present invention, suppose an image of fireworks going off in the background and people screaming in front of it, as shown in Figure 10, and add it to this image. Assuming the sound is the sound of fireworks, an explosion, and two people screaming.

A case where these video and audio are output synchronously will be explained.

FIG. 22 is a block diagram of the configuration of this fourth embodiment. In FIG. 22, the same symbols as in FIGS. 1 to 21 indicate the same parts.

In this embodiment, the video output from the video recording and reproducing section 1 shown in FIG. 22 is sent to the video storage buffer 6 and at the same time is also sent to the video change extraction section 2. The output is processed in the first change extracting section 21 in the same way as in the second embodiment with respect to fireworks being launched and exploding, to obtain a synchronized output as shown in FIG. 12.

Further, the video output input to the video change extraction section 2 is processed in the second change extraction section 22 as the video output regarding one person B is explained in the third embodiment.

A synchronized output of video and audio as shown in FIG. 18 can be obtained.

As a result, the video and audio of a person screaming in response to fireworks being launched or exploding are automatically added and output synchronously.

Note that in the image change extraction section 2 in FIG.

A first change extraction section 21 extracts changes in brightness in an extraction area of the screen, and a second change extraction section 22 extracts changes in the mouth size of a person on the screen.

Each of these image changes is searched by one image change search unit 31.
However, the audio output control section 3 including the video change search section 31 controls each of these multiple types of video changes by time-division control.

〔Effect of the invention〕

By configuring as in the present invention, various sounds are automatically added when a predictable video is output, without having to input a synchronization signal into the video in advance and create a synchronization list manually. It is possible to dynamically select and synchronously output a variety of sounds in real time.

This will greatly contribute to video editing equipment and expand the scope of use of video and audio in computer interfaces.

[Brief explanation of drawings]

FIG. 1 is a diagram showing the inventive principle of the present invention. FIG. 2 is a block diagram of the configuration of the first embodiment. FIG. 3 is a detailed explanatory diagram of example I of video and audio synchronization. FIG. 4 is a detailed explanatory diagram of the video change classification table 1. FIG. 5 is a detailed explanatory diagram of voice control command table 1. FIG. 6 is a detailed explanatory diagram of recorded audio I. FIGS. 7 to 9 are explanatory diagrams of implementation aspects of the first embodiment. Figure 10 is another example of the video. FIG. 11 is a block diagram of the configuration of the second embodiment. FIG. 12 is an explanatory diagram of another example of synchronization of video and audio. FIG. 13 is a detailed explanatory diagram of the video change classification table ■. FIG. 14 is a detailed explanatory diagram of another example of the voice control command table. FIG. 15 is a detailed explanatory diagram of another example of recorded audio. Figure 16 is yet another example of the video. FIG. 17 is a block diagram of the configuration of the third embodiment. FIG. 18 is an explanatory diagram of example (2) of synchronization of video and audio. FIG. 19 is an explanatory diagram of the video change classification table summer. FIG. 20 is an explanatory diagram of voice control command table 1. FIG. 21 is an explanatory diagram of recorded audio ■. FIG. 22 is a block diagram of the configuration of the fourth embodiment. FIG. 23 is a block diagram of a conventional example. 1...Video recording and playback section. 2...Video change extraction section. 3...Audio output control section. 4...Audio recording and playback section. 5...Timer section. 6...Video storage buffer. 7...History storage section. 31...Video change search section. 32...Video change classification table. 33...Control command generation unit. 34...Voice control command table. Climbing Applicant Fujitsu Ltd. Patent Attorney Akira Yamatani Screen 1 Screen 1 Invention Factory Map Figure 1 Blue Blue Example Q Refined Log Diagram Figure 2 Fireworks 4 - Pronunciation Figure 6 Tawei - 7ljB I Fig. 7 17tmJ The implementation of the first tribute in the 7th layer 1st 8th section.
1 Pl Sumi @P Otsu dispatch 4 pictures 1 and (10E no Hana - Fire) Fig. io Fig. 11 Fig. 12 Fig. 12 Examples of slaughter and slaughter usage ■ Fig. 13 Shaving and killing - chain table ■ Chapter 14 Fig. 4 Ip control dispute 1 Fig. 15 Koji i, ini n video image (entering chestnut) Fig. 16 Perforation 3 *sec. and audio synchronization 4 rows ■ Figure 19 Autumn wheat conversion method ■ Figure 20 Audio $9 hammer ■ Figure 21 Record of fear special Yu 4 protrusion P1 stacking plate 7 Seventh tsuku rise No. 22 figure

Claims (5)

[Claims] (1) Video recording and reproducing means (1) for reproducing and outputting recorded video, and video change extraction means (2) for extracting changes in the output video.
), and an audio output control means (3) that generates a control command for the playback output of the recorded audio based on the change in the video image.
and an audio recording and reproducing means (4) for reproducing and outputting audio output based on the control command, and outputting audio that is automatically synchronized according to changes in the recorded video output. Video and audio synchronous output device. (2) The audio output control means (3) includes: a video change search means (31), a video change classification recording means (32), a control command generation means (33), and a sound control command recording means (34). Claim (1) characterized in that the video change extraction means (2) searches and classifies the video changes inputted from the video change extraction means (2) using the video change classification table 32, and generates the audio control command based on the result. The video/audio synchronous output device described above. (3) The audio output control means (3) is characterized in that it controls the reproduction of the audio output after a certain fixed time from the video output time by comprising a timer means (5) for delaying the audio output. The video/audio synchronous output device according to item (1) or (2). (4) The video recording and reproducing means (1) includes a video storage buffer means (6) that controls the video output time of the device.
Claim (1) characterized in that by comprising the above, the sound corresponding to the change in the video is outputted apparently earlier or later than the change in the video.
Or the video/audio synchronous output device described in (2). (5) The audio output control means (3) includes a history storage means (7) that sequentially stores the history of audio output, and issues audio control commands based on the stored past history and changes in the current video. Claim (1)
) or the video/audio synchronous output device described in (2).