JPH089357A - Information processing device - Google Patents

Abstract

(57) [Summary] [Purpose] Simultaneous display of two or more images makes it easier to understand the correspondence between images and sounds. [Structure] A plurality of video display windows can be set on the bitmap display 10. Each video display window has a video display area for displaying a video and a volume display area for displaying the volume of audio accompanying the video. To do.
The CPU 20 reads the video file from the file storage device 18, decompresses it, and supplies it to the video display control device 12.
The CPU 20 also reads an audio file from the storage device 18, converts the data into a control signal and transfers the control signal to the audio control device, calculates the volume and the high and low, and displays the volume display that expresses them in the brightness and the hue. Display controller 12
To display the corresponding video in the volume display area of the video display window. When the video display is delayed with respect to the volume output, the CPU 20 thins out the video frames to synchronize the video and the audio.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus for synchronously outputting video and sound, and more specifically, an information processing apparatus for displaying a plurality of videos and outputting a sound corresponding to these videos. Regarding

[0002]

2. Description of the Related Art In a multipoint video conference system, video display windows of a plurality of communication partners are set on a monitor screen. Regarding the voice, there is a case where only one selected partner is output, and a case where the voice is output from all speaking or one or more designated partners.
In either case, there is not yet a system that notifies the user in an easy-to-understand manner in which image display window the image of the transmission source of the currently output audio is displayed.

[0003]

When a plurality of videos having related sounds are displayed simultaneously on the video display window or in individual video display devices, the currently output audio is displayed in which video display window or There is a demand for a means for displaying to a viewer or a user whether the video displayed on the video display device is simple and easy to understand.
For example, in addition to the terminals of the multipoint video conference system described above, such a function is desired in a remote monitoring system, a system for simultaneously outputting a plurality of video software, and the like.

It is an object of the present invention to present an information processing device which satisfies such a demand.

[0005]

An information processing apparatus according to the present invention is an information processing apparatus for displaying one or more videos and processing audio output associated with each of the one or more videos. A video display means for displaying a video, an audio output means,
A sound volume inspecting means for inspecting the volume of sound output accompanying the video displayed on the video display means and a volume display for indicating the volume by the sound volume inspecting means are adjacent to the related video displayed on the video display means. And a volume display means for displaying the same.

[0006]

With the above-mentioned means, the volume of the sound accompanying the displayed image is displayed in association with the image, so that when two or more images are displayed at the same time, the volume of the sound of which image is large. You will be able to check easily.

[0007]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows a schematic block diagram of an embodiment of the present invention. 10 is a bitmap display, 1
2 is a video display control device for controlling the video display of the bitmap display 10, 14 is a speaker, 16 is an audio control device for driving the speaker 14, 18 is a file storage device in which audio files and video files are stored, 2
Reference numeral 0 is a CPU that controls the whole, and 22 is a main memory of the CPU 20. These are connected to each other via the CPU bus 24.

In the main memory 22, an operation program of the CPU 20 is loaded, and an audio buffer 26 for audio data and a video buffer 28 for video data are set.

The video data and the corresponding audio data are stored in the file storage device 18 as a video file and an audio file, respectively, in a predetermined file format.
It is loaded into the main memory 22 as needed. Of course, the main memory 2 stores video data and audio data via the network.
May be loaded to 2. Video data is not limited to moving images,
It may be a raster image or the like.

FIG. 2 shows a screen example of the bitmap display 10 in which a plurality of windows 30 and 32 are displayed. Two video display windows 30 and 32 are set, and a moving image is displayed in each. The detailed structure of each window 30, 32 is shown in FIG. As shown in FIG. 3, each of the video display windows 30 and 32 has a video display area 4 at the top of the video display area 40 for displaying video.
It has a volume display window 42 for displaying the volume of audio that is paired with the video displayed at 0.

In the volume display window 42, the brightness and the hue change according to the strength and the height of the voice data. For example, the brightness is changed according to the volume, and the hue is changed according to the pitch of the sound. Specifically, it is displayed dark when the sound is low, bright when the sound is high, blue when the frequency is low, and red when the frequency is high. In addition to the change in brightness and hue, for example, the volume display window 42 is vibrated, and a meter or graph is displayed in the volume display window 42 so that the volume or volume and frequency can be roughly grasped. Just do it.

The CPU 20 controls the respective image display areas 4 of the image display windows 30 and 32 via the image display controller 12.
0 displays the video of the video file allocated by the user's designation or the like, and the volume display area 42 displays the volume of the voice of the audio file corresponding to the video displayed in the video display area 40 by the speaker output. Display in sync with. Of course, video and audio are output in synchronization.

The CPU 20 converts the voice data to be voice output into a predetermined control signal and supplies it to the voice control device 16. The voice control device 16 causes the speaker 14 to output a corresponding voice in response to a control signal from the CPU 20.

In the present embodiment, when the user gives an instruction to reproduce video / audio by inputting a command or the like, a reproduction process 50 is activated as shown in FIG.
Activates an audio process 52 for reproducing audio data and a video process 54 for reproducing video data. In addition,
It is assumed that a plurality of reproduction processes 50 and 56 can be activated at the same time. When the plurality of reproduction processes 50 and 56 are activated, it is necessary to simultaneously generate a plurality of sounds from the speaker 14, but the CPU 20 synthesizes one control signal from the sound data processed by the sound processes 52 and 58. To the voice control device 16, or individually generate control signals from the voice data processed by the voice processes 52 and 58 and send them to the voice control device 16, and the voice control device 16 outputs the control signals from the plurality of control signals. A synthetic signal of a plurality of voices may be generated. The present embodiment is not limited to the method of simultaneous voice generation. Further, in FIG. 4, video and audio are activated as separate processes, but they may be implemented by the same process.

Next, the characteristic operation of this embodiment will be described with reference to FIGS. FIG. 5 shows voice processes 52, 5
8 is a flow chart of the processing executed in 8, and FIG. 6 is a flowchart of the processing executed in the video processes 54 and 60.

First, the processing executed by the voice processes 52 and 58 will be described. In this case, the audio files are read little by little from the file storage device 18 into the audio buffer 26 prepared in the main memory 22 and processed. The CPU 20 reads a certain amount of voice data from the designated voice file of the file storage device 18 into the voice buffer 26 (S1), and if there is voice data in the voice buffer 26 (S2), analyzes the voice data, The strength and sound quality are checked (S3). The capacity of the audio buffer 26 can be arbitrarily set within the range of the capacity of the main memory 22.

Next, the CPU 20 converts the voice data into a control signal (S4), and outputs the control signal to the voice control device 16.
(S5). The voice control device 16 converts the voice control signal into an analog signal and drives the speaker 14 (S6). Then, the CPU 20 also changes the brightness and hue of the volume display area 42 according to the strength and the height of the audio data (S7).

When the data read into the audio buffer 26 is processed, the CPU 20 reads the next audio data into the audio buffer 26 (S1). S1 to S7 are repeated until all the audio data of the specified audio file is processed.
When there is no audio data in the audio buffer 26 (that is,
If the audio buffer 26 is empty) (S2), the processing on the audio data is ended.

Next, the processing executed by the video processes 54 and 60 will be described. In the video buffer 28 prepared in the main memory 22, video data is read little by little from the specified video file stored in the file storage device 18, for example, one frame at a time and processed. First, one frame of a moving image is read into the video buffer 28 (S1
1) If there is video data in the video buffer 28 (S1
2) Synchronize with the audio data (S13), while thinning out frames as needed (S14), and displaying the image in the designated image display window 30 or 32 (S15). In the present embodiment, the display of the video frame is controlled by making the display of the moving image correspond to the audio data. That is, when the video is not displayed in time, the frame is thinned to synchronize with the sound. When the image display is completed, the CPU 20 reads the next image data from the image file into the image buffer 28 (S11), and thereafter repeats S11 to S15 until there is no image data (S12). When there is no more video data in the video buffer 28 (S12), the process for the video data ends.

[0021]

As can be easily understood from the above description, according to the present invention, when a plurality of videos are simultaneously displayed and audio is output in association with each video, the video is associated with each video. You can easily know the volume of voice. That is, it becomes possible to easily know which image the audio currently output is for.

[Brief description of drawings]

FIG. 1 is a schematic block diagram of an embodiment of the present invention.

FIG. 2 is an example of a screen of a bitmap display.

FIG. 3 is a configuration diagram of video display windows 30 and 32.

FIG. 4 is an explanatory diagram of a process activated in this embodiment.

FIG. 5 is a flowchart of voice processing according to this embodiment.

FIG. 6 is a flowchart of video processing of this embodiment.

[Explanation of symbols]

 10: Bitmap display 12: Video display control device 14: Speaker 16: Audio control device 18: File storage device 20: CPU 22: Main memory 24: CPU bus 26: Audio buffer 28: Video buffer

Claims (7)

[Claims] 1. An information processing apparatus for processing the display of one or more videos and the audio output associated with each of the one or more videos, the video display means displaying the one or more videos, and the audio output means. , A volume inspection means for inspecting the volume of the sound output accompanying the video displayed on the video display means, and a volume display indicating the volume, etc. by the volume inspection means for the related video displayed on the video display means. An information processing apparatus, comprising: a volume display unit that displays the adjacent data. 2. The video display means comprises one or more video display areas for displaying one video and a volume display area for displaying a volume display of sound accompanying the video displayed in the video display area. The information processing apparatus according to claim 1, further comprising a video display window. 3. The information processing apparatus according to claim 1, wherein at least one of brightness, saturation, and hue is changed in the volume display. 4. The information processing apparatus according to claim 1, wherein the volume display is a meter display. 5. The information processing apparatus according to claim 1, wherein at least two images are displayed simultaneously. 6. The information processing apparatus according to claim 1, further comprising a synchronization unit that synchronizes the display of the image and the output of the sound accompanying the image. 7. The information processing apparatus according to claim 6, wherein said synchronization means is means for thinning out video display as necessary for video display synchronized with audio output.