JPH0478066A - Spacial audio/video control device - Google Patents

Abstract

PURPOSE:To enable a video to be watched under a circumstance similar to an image pickup spot of this video projected on a screen by controlling the audio level of an audio device disposed in a surrounding space of the audience in order to make a difference signal between audio information on the audience side and audio information on the image pickup side zero. CONSTITUTION:Environmental information on the image pickup side is outputted from a signal source 11 and then inputted to a space control device 14, while spot environmental information is inputted to the space control device 14 from sensors 15 and 16 disposed around the audience. Then, the spot side environmental information and the audience side environmental information are compared with each other by the space control device 14, where their difference signal is detected and supplied to an audio control device 17 as an adjusting signal used for sound pressure to be outputted from speakers 13A, 13B and 17a-17d, and when the difference signal becomes zero, this adjusting state is maintained. By this method, the environment set on the spot of the image pickup and the environment in the surrounding space of the audience become the similar states.

Description

DETAILED DESCRIPTION OF THE INVENTION [Object of the Invention] (Industrial Application Field) The present invention relates to a spatial audio/video control device applied to, for example, a home theater.

(Prior Art) Recently, in the field of video technology, a system has been developed that displays images on a large screen using a projector. In this system, a large number of speakers are also used in the audio device to enhance the sense of presence.

(Problem to be solved by the invention) However, the acoustic effects and video effects (brightness, hue, etc. of the video) to create a sense of presence, and even the spatial lighting where the viewer is located, are all up to the user to adjust. has been done. For this reason, for example, a discrepancy occurs between the environment at the camera position when the image is captured and the environment when the image is actually viewed on a large screen.

SUMMARY OF THE INVENTION An object of the present invention is to provide a spatial audio/video control device that can match the environment of the camera position when photographing a subject with the viewing position as much as possible, and further improve the sense of presence.

[Structure of the Invention] (Means for Solving the Problem) The present invention corresponds to the on-site environment in which the video signal displayed on the display was photographed, and detects at least the audio information on the photographing side superimposed on the video signal. means for detecting at least an audio state in a space close to a viewer in a state in which the video signal is displayed on the display, and outputting audio information on the viewer side; and sensor means for outputting audio information on the viewer side; and photographing-side audio information to obtain a difference signal, and control the audio level of an audio device placed in the surrounding space of the viewer so that the difference signal becomes zero.

(Operation) By the above means, in the space around the display,
Viewers can view the video in an environment that is extremely similar to the filming location of the projected video, giving them a sense of realism.

(Example) Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows an embodiment of the present invention. 11 is a large screen display device, and its signal source 12 is, for example, a video tape recorder or a tuner. The display device may be a large screen on which images are projected by a liquid crystal projector.

Further, 13A and 13B are left and right channel speakers.

In this system, the composite video signal output from the signal source 12 includes photographing side environment information. The shooting-side environment information refers to shooting-side audio information, shooting-side lighting information, and shooting-side peripheral color information that corresponds to the site environment in which the video signal displayed on the display was shot and is superimposed on the video signal. It is.

These photographing-side environment information are output from the signal source 1 and input to the space control device 14. The space control information 14 includes
Site environment information is input from sensors 15 and 16 placed around the viewer 100. This on-site environment information includes audio information on the viewer's side, lighting information on the viewer's side, peripheral color information on the viewer's side, etc. in a space close to the viewer when a video signal is displayed on the display, and the environment on the shooting side. Corresponds to information.

The space control device 14 compares the site-side environmental information and the viewer-side environmental information and detects a difference signal. The difference signal of the audio information is supplied to the audio control device 17, and the speakers 13A, 13B and 1.7a~], 7
It is used as an adjustment signal for the sound pressure output from d.

When the differential signal becomes zero, the adjusted state is maintained. In addition, the difference signal related to lighting information is the lighting control device]
8 and is used as a brightness control signal for the lighting devices 188 to 1.8e. When the differential signal becomes zero, the adjusted state is maintained. Further, a difference signal regarding peripheral color information is input to the video control device 19.

The video control device 9 controls the color level and hue of the display device 1 according to the differential signal. When the differential signal becomes zero, the adjusted state is maintained.

Due to the automatic environment control described above, the environment set at the filming location and the environment in the space surrounding the viewer are brought into a state that is extremely similar.

FIG. 2 shows an example of the configuration of the sensor 15.

This sensor 15 is provided with a microphone 21, a lighting sensor 22, and an image sensor 23. The image sensor 23 uses a color CCD and is capable of capturing peripheral color information.

In the embodiment shown in FIG. 1, two sensors are shown, but in order to capture the surrounding environment more accurately, multiple sensors may be arranged to distinguish and detect directions (environmental areas). .

FIG. '3 is a diagram showing the position where the on-site environment information is superimposed on the video signal. For example, it is superimposed on a part of the vertical retrace period where the character multiplex signal is superimposed.

FIG. 4 shows the data format of the site environment information, which includes a synchronization clock, part of the header, audio information, lighting information, and surrounding color information. This information can be captured in the same way as a text multiplex signal, for example, and by adding identification information of the data content, the text multiplex signal processing circuit can also be used.

FIG. 5 shows the basic configuration of the space control device 14. The site-side environment information is input to the first capture circuit 31 , and the viewer-side environment information is input to the second capture circuit 32 . The data taken in here are compared in a comparison circuit 33 according to their corresponding types, and a difference signal of each data is taken out. The difference signal related to audio is latched in a latch circuit 34, the difference signal related to illumination is latched in a latch circuit 35, and the difference signal related to spatial color is latched in a latch circuit 36.

The output of each latch circuit 34, 35, 36 is then supplied to the corresponding control device.

By the way, as for the on-site environment information, there may be cases where it is not possible to achieve a sense of realism by faithfully representing the environment information at the shooting position on the on-site side. It is preferable that the on-site environmental information be presented to some extent in accordance with the video content. For example, if you zoom in on a subject from a long distance, the actual shooting location may be far away from the subject.
The video content will be very close to the subject.

Therefore, a system is needed that artificially creates environmental information and multiplexes it with the video signal.

FIG. 6 shows a system that multiplexes on-site environment information onto a video signal. - The signal once photographed is sent to a large screen display device 31 via a signal source (VTR or camera).
supplied to Here, the program producer 50 operates the on-site information device 45 while looking at the screen to create the surrounding spatial environment.

That is, the output of the on-site information manpower device 45 is input to the data generator 44 . This data generator 44 is a fourth
The system generates data in the format shown in the figure, that is, environmental information, and each piece of information is variably controlled to match the operator's power.

This environmental information is manually input to the corresponding audio control device 37, lighting control device 38, and video control device 39, respectively. This program production room has the same equipment as the viewing room described in FIG. 1, and has speakers 37a to 37d.
, lighting fixtures 38a to 38e are arranged. Therefore,
The program producer 50 can produce sound, lighting, and images (colors) while looking at the screen.

The environmental information of the data generator 44 is also input manually to the multiplex circuit 42 . A video signal being displayed from the signal source 32 is input to the multiplexing circuit 42 via a delay circuit 41 .

The purpose of this delay circuit 41 is to synchronize the time between the environmental information generated by the operation of the program producer 50 and the video signal input to the multiplexing circuit 42 .

In the multiplexing circuit 42, as explained in FIG. 3, environmental information is multiplexed into a part of the vertical retrace period. The output video signal from this multiplex circuit 42 is transmitted to, for example, a broadcast VTR 4.
3 and recorded on tape.

Thereby, the video signal of the signal source 12 explained in FIG. 1 can be obtained.

Various embodiments are possible as the field information input device 45.

For example, regarding audio information, by inputting the output level information of each channel (speaker), it is possible to realistically reproduce the sound effects when oncoming cars passing each other at high speed, for example. Regarding lighting, when an image is taken on a moonlit night, the effect can be achieved by dimming the entire image. Furthermore, if you want to further emphasize the surrounding colors, such as in a sunset scene, you can further enhance the atmosphere by preparing color control information.

In the above embodiment, when controlling the surrounding color using surrounding color information, the color signal of the display device is controlled. However, the present invention is not limited to this, and the surrounding color may be controlled by preparing a so-called colored lighting device in combination with the lighting device and controlling this lighting device.

[Effects of the Invention] As explained above, according to the present invention, the environment of the camera position when photographing the subject matches as much as possible the environment of the viewer's position, and the sense of realism can be further improved. .

[Brief explanation of the drawing]

FIG. 1 is a configuration explanatory diagram showing one embodiment of the present invention, FIG. 2 is a diagram showing an example of the sensor shown in FIG. 1, FIG. 3 is a diagram showing an example of multiple positions of environmental information, and FIG. FIG. 5 is a diagram showing an example of the data format of environmental information, FIG. 5 is a diagram showing the principle of the space control device shown in FIG. 1, and FIG. 6 is a diagram showing an example of a system for multiplexing environmental information onto a video signal. 11... Display device, 12... Signal source, 13
A, 13B, 17a-17d-XP power, 14... Space control device, 17... Audio control device, 18...
- Lighting control device, 19... video control device. Applicant's agent Patent attorney Takehiko Suzue

Claims (4)

[Claims] (1) On-site information extraction means that corresponds to the on-site environment in which the video signal to be displayed on the display was shot and that extracts at least the audio information on the shooting side that is multiplexed with the video signal; sensor means for detecting at least an audio state in a space close to the viewer in a projected state and obtaining audio information on the viewer side; and spatial control means for controlling the audio level of an audio device placed in the space surrounding the viewer so that the difference signal becomes zero. (2) The on-site information extraction means further extracts on-site lighting information multiplexed with the video signal, and the sensor means further detects viewing-side lighting information in a space close to the viewer, The space control means further compares the viewer-side illumination information and the photographing-side illumination information to obtain a difference signal, and controls lighting equipment arranged in the space around the viewer so that the difference signal becomes zero. The spatial audio/video control device according to claim 1, characterized in that: (3) The on-site information extraction means further extracts on-site color information multiplexed with the video signal, and the sensor means further detects viewing-side color information in a space close to the viewer, The spatial control means further compares the viewer side color information and the photographing side color information to obtain a difference signal, and controls the color control unit of the display so that this difference signal becomes zero. A spatial audio/video control device according to claim 1. (4) The on-site information extraction means further extracts on-site color information multiplexed with the video signal, and the sensor means further detects viewing-side color information in a space close to the viewer, The space control means further compares the color information on the viewer side and the color information on the photographing side to obtain a difference signal, and controls color lighting equipment arranged in the space around the viewer so that the difference signal becomes zero. 2. The spatial audio/video control device according to claim 1, wherein the spatial audio/video control device controls: