JPH10173976A - Image data receiving device - Google Patents

Abstract

(57) [Summary] An image data receiving apparatus capable of updating a part of a background image without interfering with remote operation of an imaging apparatus on a transmission side is provided. An image capturing range of a video camera is sequentially changed by remote operation, and images are combined, so that an image of the entire photographable range is used as a background image as a background image screen.
2 and display. Then, when the imaging range of the video camera is remotely controlled from the image data receiving device, the background image in the new camera frame of the current designated range is displayed in reverse until the image corresponding to the current designated range is received. It is displayed in the background image in distinction from the camera frame 158 in the previously specified range. Further, the background image at the corresponding position is updated using the bitmap data of the main image newly captured in the range of the new camera frame. This allows for a partial,
The latest background image can be provided to the user.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image data receiving apparatus, and more particularly to an image data receiving apparatus capable of remotely controlling a photographing apparatus such as a video camera.

[0002]

2. Description of the Related Art Image data captured by a video camera located at a remote location is received and displayed on a display device, and the image capturing range of the video camera or the like can be remotely controlled on the receiving side. A receiving device is used in various situations. For example, a technique described in Japanese Patent Application Laid-Open No. 6-121229 is disclosed as an image data receiving apparatus for freely selecting a region desired by a user from a display screen and enlarging the region. Has been proposed. This image data receiving device specifies an arbitrary area in the image displayed on the image display unit by the display screen control unit, enlarges the image information of the specified area to the display area of the image display unit, and displays the image. The output is enlarged to a part. Further, Japanese Patent Application Laid-Open No. Hei 6-205407 proposes a technique for operating a selection of a received image and a setting of an area on an image receiving side in a videophone. In this technique, the receiving side can switch between the camera input unit and the document camera input unit on the transmitting side, or control the swing function and zoom function thereof. In this case, control information for controlling the camera input unit and the like is input from the partner image input operation unit on the receiving side. Upon receiving this control information, the transmitting side controls the camera input unit and the document camera input unit on the transmitting side based on the received control information.

[Problems to be solved by the invention]

However, if the time lag is relatively large, as in the case where compressed image data is transmitted and received by wireless communication such as a mobile phone, even if an instruction to shift the shooting range to the right by remote control is given, You need to wait for a while until the screen is displayed. If there is no target image at a position where the photographing range is shifted, useless video is displayed. In order to obtain a desired image, it is necessary to shift the photographing range again, which requires a long time as a whole. Such a problem is conspicuous when the communication speed is low. However, even if the communication speed is high, useless video may be displayed in order to immediately acquire the target video, which takes time. Then it was a common problem.

Further, in the image data receiving apparatus, if the time has elapsed since the background image was fetched, there is a possibility that a difference occurs between the currently viewed background image and the actual background. For this reason, it is conceivable to repeat the capture of a whole new background image at predetermined time intervals.However, the background image needs to be received and combined with a plurality of divided screens. There is an inconvenience that remote operation cannot be performed temporarily.

Accordingly, the present invention has been made to solve such a problem, and it is possible to update a part of a background image without interfering with remote operation of an imaging device on a transmitting side. It is an object to provide an image data receiving device.

[0006]

According to the first aspect of the present invention, there is provided an image receiving device for receiving an image from an image display device and an image pickup device having a position control mechanism capable of changing the position of an image pickup device. A plurality of images taken at different positions of the image sensor, sequentially received by the image receiving means, combined into one image, and displayed on the image display device; and Area designating means for designating a region that can be imaged from within the display range of the composite image displayed on the image display device and transmitting the image to the imaging device; and the image sensor corresponding to the region designated by the region designating device An image incorporation means for receiving an image picked up by the image reception means and incorporating the image captured in the corresponding area of the synthesized image synthesized by the image synthesis means in an image data receiving apparatus. It is formed.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the image data receiving apparatus of the present invention will be described in detail with reference to FIGS. (1) Overview of Embodiment In this embodiment, the image capturing range of a video camera is sequentially changed by remote control, and images are combined, so that images of the entire photographable range are combined as background images on a window. To display. By looking at the background image, the user can know the range in which the main image can be confirmed in detail. Then, it is possible to easily specify the position and range in which the display of the main image is desired. Further, when the image data receiving apparatus transmits the designated position and range, the transmitting station changes the position and zoom of the video camera, captures image data for the designated range, and transmits the image data. At this time, the image data receiving apparatus sets the current designated range and the previously designated range (the range currently displayed on the screen) to the new camera frame and the last designated range until the image corresponding to the current designated range is received. It is displayed as a camera frame in the background image. Thus, the user can immediately recognize whether the video currently displayed on the screen is the image switched to the current designated range or the image before the switching. Further, in the present embodiment, the background image at the corresponding position is updated using the bitmap data of the main image newly captured in the range of the new camera frame. As a result, it is possible to provide the user with a partial but up-to-date background image.

(2) Details of Embodiment FIG. 1 shows a system configuration of an image data communication system using the image data receiving apparatus of the embodiment. As shown in this figure, an image data communication system includes a transmitting station 1 for capturing and transmitting an image, and a receiving side for remotely controlling the capturing of an image by the transmitting station 1 and receiving and displaying image data. And a station 2. This image data communication system, for example, monitoring and reporting the progress of building sites, etc.,
It can be widely used as remote monitoring of places where humans cannot always be present, investigation of fires and dams, transmission of news images taken in remote places, production tools for television programs and events, and the like.

The transmitting station 1 mainly includes a video camera 4, a control unit 5, an image transmitting device 6, a mobile phone 7, and a modem 8. The video camera 4 can be connected to and disconnected from the image transmission device 6 with an NTSC cable. The video camera 4 constantly captures images and converts image data based on NTSC signals into, for example, 3 to 5
The image data is supplied to the image transmission device 13 periodically at intervals of seconds. The control unit 5 can connect to and disconnect from the image transmission device 6 via an RS232C cable. This control unit 5
Controls the imaging angle (up / down angle = pan, left / right angle = tilt) of the video camera, the imaging range by zooming, focus, etc., according to the camera position change command supplied from the receiving station 2 via the image transmission device 6. It is supposed to.

Although not shown, the image transmission device 6 includes a CPU for performing various controls related to transmission and reception of image data,
R storing programs for various controls by PU
OM, a memory for storing image data and the like (flash memory, S-RAM, etc.), a conversion unit for converting an NTSC signal to an RGB signal, a compression unit for compressing image data, a video camera 4, a control unit 5, It is provided with various connection terminals for connecting the mobile phone 7, the modem 8, the power cable and the like, and other devices. The image transmission device 6 receives the camera position change command from the receiving station 2 and supplies the command to the control unit 5, and converts the image data supplied from the video camera 4 from the NTSC signal to the RGB signal by the conversion unit. The compression unit compresses the image data by a predetermined method to obtain compressed image data. The image transmission device 6 adds the positional information (pan, tilt, zoom value) of the camera to the header of the compressed image data and transmits the compressed image data to the receiving station 2.

The transmission of the compressed image data is performed through the side of the cellular phone 7 and the modem 8 to which the communication line between the transmitting station 2 is connected. For compression of the image data in the image transmission device 6, various existing compression methods can be adopted. For example, Japanese Patent Application Laid-Open No. 5-227
The data is compressed by the FST compression method described in Japanese Patent No. 547. FST compression encodes an A / D converted video signal into a matrix block consisting of a plurality of pixels and a bitmap representing one of two types of reference values, and finds non-redundant information in the coded block. Identifying and coding and comparing each block to the corresponding block of the immediately preceding frame to eliminate inter-block and inter-frame redundancy and to further reduce the current color value relative to the immediately preceding color value. The amount of information is compressed by coding in the form of Other image compression methods include MPEG, JPEG, and JP-A-8-154.
Various methods such as TIM compression described in Japanese Patent No. 261 may be used.

TIM compression is a method of image compression in which decompression processing of compressed image data can be easily performed on the image data receiving device side. In image compression, TIM compression has the following characteristics: (1) the human eye is sensitive to luminance changes but insensitive to color changes; and (2) is often used when pixels constituting an image are appropriately blocked. The image compression is performed based on the assumption that there are usually only two colors in one block which is generally established in the natural image. That is, each pixel data is divided into image data composed of a luminance signal Y and color difference signals U and V, and block data composed of n × m (usually 4 × 4) is generated. Then, two colors of a first color component (y1, u1, v1) and a second color component (y2, u2, v2) having a luminance signal and a color difference signal, which represent the generated block, and a first color component and a second color component are represented. Data is compressed by generating a block component consisting of an n × m bitmap indicating the distribution of two color components. Then, the generated block component is coded from the block component, a similar block having the same or most similar block component, and the code data indicating the similar block and the difference data with respect to the block component of the similar block. By doing so, the data is further compressed and transmitted to the image data receiving apparatus.

The image data compression employed in the present embodiment is processed by an image compression board (printed board) arranged in the image transmission device 6.
Compression may be performed by software processing such as JPEG. The image transmission device 6 is provided with a function of encrypting compressed image data using a predetermined encryption key in order to maintain the secrecy of the communication contents, and the encrypted compressed image data is transmitted to the receiving station 2. You may make it transmit.

On the other hand, the receiving station 2 is mainly composed of a mobile phone 9 and a personal computer 10 to which the mobile phone 9 is connected / disconnected (hereinafter simply referred to as a personal computer 10). Mobile phone 9 and mobile phone 7
Is mainly 9600b via digital mobile communication network
The connection is made by high-speed communication of ps or 19200 bps, but another communication method may be used.
For example, ISDN (Integrated Services Digital Network
ork), ordinary telephone line network, Internet, FAX
Communication via various data communication networks such as a communication network, PHS, wireless satellite communication, and optical communication may be performed. Various types of telephones can also be used for the mobile phones 7 and 9 on the transmitting and receiving sides, and different types of telephones may be used. Further, the communication speed between the transmitting and receiving devices 1 and 2 may be automatically set according to the communication capabilities of the mobile phones 7 and 9 and the modem 8.

FIG. 2 shows the configuration of the personal computer 10. As shown in FIG. 2, the personal computer 10 includes a control unit 11 for controlling the entire apparatus. The control unit 11 includes a keyboard 13, a mouse 14, a display device 15, a storage device 16, a storage medium drive device 17, a communication control device 18,
Also, an input / output IF 19 is connected.

The control unit 11 includes a CPU 111 functioning as a so-called computer, a ROM 112, a RAM 11
3 is provided. The ROM 112 is a read-only memory in which various data and programs are stored in advance.
The RAM 113 is a random access memory used as a working memory by the CPU 111. This RA
When the personal computer 10 is used as the image data receiving device of the present embodiment, a background image file,
An area for storing data of a main image file, a camera position change command, and a camera type is secured.

The keyboard 13 has various keys such as a kana key and a numeric keypad for inputting a kana character, a function key for executing various functions, a cursor key, and the like. As the display device 15, for example, a CRT or a liquid crystal display is used. The display device 15 includes a main image window for displaying an image captured by the video camera 4,
A camera control window or the like for remotely controlling the imaging position of the video camera 4, the zoom value, and the like is displayed. The camera control window displays camera control keys and a background image. The main image window and the camera control window can be simultaneously displayed, or only one of them can be displayed. In the case of simultaneous display, both windows can be displayed side by side or overlaid. The mouse 14 is a pointing device, and is an input device for designating a corresponding function by left-clicking a key, an icon, or the like displayed on the display device 15. In the present embodiment, the mouse 14 is used to instruct the capture and synthesis of the background image, to specify the imaging position of the video camera 4 by dragging the camera frame displayed in the background image, and to set the size of the camera frame. Or change.

The storage device 16 is composed of a readable and writable recording medium and a drive device for reading and writing various information such as programs and data on the storage medium.
As the storage medium used for the storage device 16, a hard disk is mainly used, but a readable / writable storage medium among the storage media used in the storage medium driving device 17 described later may be used. . The storage device 16 stores the types of the video cameras 4 that can be connected to the image transmission device 6 and information (zoom, pan, tilt range, and the like) on items that can be controlled by each video camera. Also, a dial number for connecting to the transmitting station 1 and a background image once captured and synthesized are stored for each transmitting station. The program storage area of the storage device 16 stores various application programs such as an image data reception-related program according to the present embodiment, in addition to a basic program such as an OS for operating the personal computer 10. In the receiving station 2 of the present embodiment, a program for receiving the compressed image data from the transmitting station 1 and expanding the compressed image data by a method corresponding to the image compression method by the transmitting station 1 is stored in the storage device 16. Is stored in For example, the image transmission device 6 of the transmitting station 1
When performing image compression by G, the storage device 16 stores the MPE
A program for performing expansion by G is stored. As described above, in the image data receiving apparatus according to the present embodiment, it is not necessary to set special hardware for image expansion in the receiving station 2. When the compressed image data transmitted from the transmitting station 1 is encrypted, a program for performing decryption using the corresponding key is also stored in the storage device 16.

The recording medium driving device 17 is a driving device for the CPU 111 to read a computer program from an external recording medium. The computer program recorded on the recording medium includes the personal computer 1 of the present embodiment.
0, an application program related to image data reception, and dictionaries and data used therein. Here, the recording medium refers to a recording medium on which a computer program is recorded, and specifically,
Magnetic storage media such as floppy disks, hard disks and magnetic tapes; semiconductor storage media such as memory chips and IC cards; storage media such as CD-ROMs, MOs and PDs (phase change rewritable optical discs); A computer program is recorded by a recording medium using paper (and a medium having a function equivalent to paper) such as a printed matter for reading a program using a paper card, a paper tape, and a character recognition device, and other various methods. A recording medium is included. As a recording medium used in the personal computer 10 of the present embodiment, a CD-ROM or a floppy disk is mainly used. The recording medium drive device 17 can read data from the RAM 113 and the storage device 16 in the case of a writable recording medium such as a floppy disk, in addition to reading a computer program from these various recording media. .

In the personal computer 10, the CPU 111 reads a computer program from an external recording medium set in the recording medium driving device 17 and stores (installs) it in the storage device 16. Then, when the image data reception related program according to the present embodiment is executed, the corresponding program is read from the storage device 16 into the RAM 113 and executed. However, it is also possible to execute reading and reading directly from the external recording medium to the RAM 113 by the recording medium driving device 17 instead of the storage device 16. Also, depending on the personal computer 10, the program related to the image data reception of the present embodiment may be stored in the ROM 112 in advance.
And the CPU 111 may execute this.

The communication control device 18 has a connection terminal for the mobile phone 9, and transmits a camera position change command for remotely operating the video camera 4 and receives compressed image data from the transmitting station 1. It is supposed to do. Further, the communication control device 18 can transmit and receive various data such as text data and bitmap data to and from another personal computer or the like. The input / output IF 19 is an interface for connecting / disconnecting a printing device for performing various printings such as images and characters displayed on the display device 15 and a speaker for outputting voices and music. As the printing device, various printing devices such as a laser printer, a dot printer, an ink jet printer, a page printer, a thermal printer, and a thermal transfer printer are used.

Next, the operation of transmitting and receiving image data by the image data communication system configured as described above will be described. FIG. 3 shows a display screen of the display device 15 of the present embodiment. As shown in FIG.
On the display screen 5, a main image window 151 in which an image captured by the video camera 4 is displayed, and a camera control window 152 for remotely controlling an imaging position, a zoom value, and the like of the video camera 4 are displayed. On the left side of the drawing of the camera control window 152, “Full screen capture” key 153 and “Detailed setting” key 1
54, a “cancel setting” key 155, and a “send setting” key 156 are arranged. Also, in the camera control window 152, a background image screen 157 in which the entire range that can be imaged by synthesizing images captured at each position of the video camera 4 is displayed as a background image is arranged. In the background image screen 157, a camera frame 158 that displays the image capturing position and range of the video camera 4 is displayed. Background image screen 157
Cannot be imaged at once by the video camera 4, so the background image is imaged for each divided screen including a plurality of small areas, and each divided screen is synthesized and displayed.

A “full screen capture” key 153 of the camera control window 152 is a key for instructing capture of a background image displayed on the background image screen 157. A “detailed setting” key 154 is a key for setting a luminance level, a hue level, manual operation of focus, and other detailed contents of the video camera 4. When this key is left-clicked, the camera control window 152 is set. Is extended to the lower side, and each setting item is displayed. The “cancel setting” key 155 is a key for canceling the change operation when left-clicked after changing the position or range of the camera frame 158 in the background image screen 157. Canceling the change operation using this key is effective only before the “setting transmission screen” key is left-clicked.
The “setting transmission” key 156 is a key for requesting the image transmission device 6 to change the imaging position and range of the video camera 4.

FIG. 4 explains each divided screen when a background image is captured. As shown in FIG. 4, the background image screen 157 is divided into divided screens 157a to 157l, and images captured for each divided screen are combined and sequentially displayed on the background image screen 157. At this time, the exposure and the hue of each screen may be adjusted to make it easier to see. The movable angle of the pan of the video camera 4 is θp,
The tilt movable angle is θt, the position of the video camera 4 at the upper leftmost position is the origin (θp = θt = 0 °), the horizontal angle of view of the video camera 4 when the zoom value is the widest angle is αp, and the vertical angle is αp. The angle of view is αt, the number in the horizontal direction of the divided screen is y from the left, and the number in the vertical direction is x from the upper side (divided screen 1
When 57i is y = 3, x = 2), the control unit 11 calculates the coordinates of pan and tilt for each divided screen according to the following equations (1) and (2). Pan coordinates = (x−1) αp (1) Tilt coordinates = (y−1) αt (2) The control unit 11 transmits the calculated data of the pan and tilt coordinates of the divided screen to the video camera 4 sequentially. Is transmitted to the image transmission device 6 together with the position change command, the video camera 4 is remotely operated, and the image at the corresponding division position is received and synthesized as a background image. The number of divisions of the background image in the horizontal direction is (θp / αp) +1, and the number of divisions in the vertical direction is (θt /
αt) +1. The image transmission device 6 receives the bread,
When the tilt coordinates are supplied to the control unit 5, the control unit 5 moves the video camera 4 to the corresponding coordinate position.

FIG. 5 shows a change in the background image screen 157 when the desired imaging position and range (size) of the video camera 4 are remotely controlled while confirming the entire imageable range with the background image. is there. 14A shows a screen before the camera frame 158 is changed, FIG. 14B shows a screen in which a new camera frame 159 is set, and FIG.
5 shows the screen after receiving the main screen corresponding to. In the state before the change shown in FIG. 5A, the current image capturing position and range of the video camera 4 are indicated by a camera frame 158, and the image captured at this camera position is displayed in the main image window 151 (see FIG. 3). Is displayed. By moving and dragging the mouse cursor on the frame of the camera frame 158, the size of the camera frame 158 can be changed.
Further, the position of the camera frame 158 can be changed by moving the mouse cursor into the frame and dragging it. Since the user can confirm the entire range in which the image can be captured by remotely operating the video camera 4 by the background image, the user can easily change the camera position and range desired by the user.

When the position and size of the camera frame 158 are changed by operating the mouse 14, a new camera frame 159 is created at the position after the change, as shown in FIG. The background image is displayed in reverse. Since the camera frame 158 indicates the current imaging position and range of the video camera 4 (the image is displayed in the main image window 151), the camera frame 158 is displayed on the background image screen 152 as the current camera frame together with the new camera frame 159. Is displayed. If the range of the main image displayed in the main image window 151 is within the range of the new camera frame 159, the user selects the “setting transmission” key in the camera control window 152 to fix the new camera frame. Alternatively, the new camera frame may be determined by moving and releasing the mouse button while pressing it. As a result, the position information (pan, tilt, and zoom values) of the video camera 4 corresponding to the new camera frame 159
Is transmitted from the personal computer 10 to the image transmission device 6.

On the other hand, the image transmission device 6 periodically captures image data captured by the video camera 4 at predetermined intervals, and reads the position information (pan, tilt, and zoom values) of the video camera 4 at that time. The position information is added to the header of the image data on which the predetermined image processing has been performed, and transmitted to the personal computer 10. Then, the image transmission device 6
Receives the camera position change command from the personal computer 10, changes the angle and zoom of the video camera 4 via the control unit 5 so as to correspond to the new camera frame 159. The image data after the change is captured by the video camera 4 and the personal computer 1
Sent to 0. If it is time to take an image of the video camera 4 while moving from the position of the camera frame 158 to the new camera frame 159, the image data and camera position information at that time are transmitted to the personal computer 10.

In the personal computer 10, the position of the received image data is confirmed from the header of the image data, and the new camera frame 1 is checked.
If it does not correspond to the image data 95, it is determined that the image data is in the middle of the movement of the video camera 4, and the position of the camera frame 158 and the main image of the main image window 151 are displayed while the new camera frame 159 is displayed in reverse. Update. If the received image data corresponds to the new camera frame 159, as shown in FIG.
Of the camera frame 15
8 is deleted. Then, the image data received corresponding to the camera frame 159 is displayed in the main image window 151 as a main image.

Further, since the image received corresponding to the camera frame 159 is the latest image data, the background image in the camera frame 159 is also updated to the latest image data. This allows
Although partial, the background image in the range captured by the remote operation of the user is sequentially updated to the latest image.
In FIG. 5C in which the background image in the camera frame 159 is updated, a gull is flying at the upper left of the yacht, as compared with FIG. It is understood that it is a background image.

Next, details of the operation of capturing the background image will be described with reference to the flowcharts of FIGS.
First, the control unit 11 of the personal computer 10 reads out the dial number of the mobile phone 7 connected to the image transmission device 11 from the storage device 16 via the mobile phone 9 and automatically dials to connect a communication line. When there are a plurality of transmitting-side stations 1 to be remotely controlled by the personal computer 10, the names, installation locations,
Information such as a dial number is read from the storage device 16 and displayed on the display device 15 to prompt the user to make a selection. Then, the control unit 11 automatically dials the mobile phone 7 of the selected transmitting station 1 and connects the communication line (step 11). Note that the connection of the communication line with the image transmission device 6 is established when a manual dial is selected by the user.
The user makes a call to the mobile phone 9 or a dial number input from the keyboard 13.

Next, the control section 11 checks with the image transmission apparatus 6 whether or not a camera (video camera 4 and control section 5) capable of remote control is connected to the image transmission apparatus 6 (step 12). If the connection is not established (N), the process is terminated and the process proceeds to another process. On the other hand, when the video camera 4 or the like is connected (step 12; Y), the control unit 1
1 inquires of the type of the video camera 4 to the image transmission device 6 according to the following procedure (step 13). First, the control unit 1
1 transmits to the image transmission device 6 a command for asking the type and version of the camera. Upon receiving this command, the image transmission device 6 checks the type and version of the camera via the control unit 5 and transmits the same to the personal computer 10. Upon receiving the answer of the type and version of the camera, the control unit 11
Similarly, the image transmission device 6 is inquired about the commands for asking the pan range, the tilt range, and the zoom range of the video camera 4 sequentially. When the inquiry about all of the camera type, version, pan range, tilt range, and zoom range is completed, the control unit 11 stores these in the camera type area of the RAM 113 as camera type information.

Next, the control unit 11 accesses the storage device 16 and, in step 11, the transmitting station 1 connected to the line.
It is confirmed whether or not a background image corresponding to the image has already existed as a background image file (step 14). If there is a corresponding background image (step 14; Y), the storage device 16
Then, the background image corresponding to the connected transmitting station 1 is read from the background image file and stored in the background image file in the RAM 113 (step 15). Further, the control unit 11
Displays the read background image on the background image screen 1 of the display device 15.
57 is displayed (step 16), the present process is terminated, and the process proceeds to another process.

On the other hand, if the background image does not exist in the storage device 16 (step 14; N), the control unit 11 performs a process of sequentially fetching the background image from a plurality of divided screens. That is, the control unit 11 monitors the user's selection of the "take in all screens" key (step 17). When the “full screen capture” key is selected (Y), the control unit 11 calculates the coordinates of pan and tilt when capturing the background image from the angle of view of the camera. For example, in the example shown in FIG.
The coordinates of pan and tilt for each of
Calculated by the above equations (1) and (2),
(Step 18).

Next, the control unit 11 transmits a command to move the video camera 4 to the corresponding division position of the background image to the image transmission device 6 (step 19; FIG. 7). With this command, the imaging position (pan, tilt) of the video camera 4 is changed. Then, the control unit 11 receives the compressed image data sequentially transmitted from the image transmission device 6 via the mobile phone 9 and the communication control device 18 (Step 2).
0), it is confirmed from the position information of the video camera 4 added to the header whether or not the received compressed image data is data captured at the designated position (step 21). If the received compressed image data is not the data at the designated position, that is, the image data is captured before or during the movement of the video camera (Step 21; N), the process returns to Step 20 to receive the compressed image data again. I do.

On the other hand, if the received compressed image data is data at the designated position (step 21; Y), the control unit 11
Expands (decodes) the received compressed image data by a method corresponding to the compression method in the image transmission device 6 and converts it into bitmap data (step 22). The converted bitmap data of the divided image is stored at the corresponding division position of the background image file in the RAM 113 (step 2).
3). Then, the control unit 11 displays the contents of the background image file in the RAM 113 on the background image screen 157 (step 24). As a result, the background image in the range where the capture of the divided image is completed is displayed on the background image screen 157.

Next, the control unit 11 confirms whether or not the capture of the background images corresponding to all the divided screens has been completed (step 25). If not finished (Step 2
5; N), the control unit 11 updates the corresponding division position of the division screen to be taken in next as the background image (Step 26),
Returning to step 19, the division image capturing process is continued. On the other hand, when all background images have been taken (step 2
5; Y), the bitmap data of the entire background image stored in the RAM 113 is stored in the background image file of the storage device 16 in association with the currently connected transmitting station 1 (step 27). This ends the processing,
Move to another process.

Next, details of the operation of updating the camera frame will be described with reference to the flowcharts of FIGS.
The control unit 11 controls the image transmission device 6 of the transmitting station 1.
, The compressed image data sequentially transmitted from the controller (step 31), and the position information including the camera position (pan, tilt) and zoom value added to the header of the compressed image data is read (step 32). And the control unit 1
1 draws a camera frame 158 on the background image screen 157 of the camera control window 152 from the read position information as shown in FIG. 5A (step 32). Further, the control unit 11 expands (decodes) the received compressed image data by a method corresponding to the compression method in the image transmission device 6 and converts the data into bitmap data (step 3).
4). The converted bitmap data is stored in the main image file in the RAM 113, and is stored in the main image window 1
Displayed at 51 (step 35). Therefore, an image in a range corresponding to the camera frame 158 of the background image screen 157 is set as the main image, and the main image window 151 is displayed.
Will be displayed.

Here, the control section 11 determines whether or not the camera position change command has been transmitted to the image transmission device 6 (processing in step 42) (step 36). If not transmitted (step 36; N), the control unit 11 determines whether the camera frame 158 has been clicked by the user,
If not clicked within the predetermined time (step 3
7; N), returning to step 31 to continue the processing. When the camera frame 158 is clicked (step 37;
Y), the control unit 11 acquires the position and size of the new camera frame 159 set by the user (step 3).
8) It is monitored which of the “setting abort” key and the “setting transmission” key has been clicked (steps 39 and 40). When the “cancel setting” key is clicked (Step 39; Y), the control unit 11 cancels the display of the new camera frame 159 (Step 41) and returns to Step 31.

When the "setting transmission" key is clicked (step 40; Y), the position and size of the new camera frame 159 acquired in step 38 are converted into pan, tilt and zoom camera commands (step 40). 42), and transmits a camera position change command to the image transmission device 6 (step 43), and reversely displays the background image in the new camera frame 159 (step 44). In this way, by displaying the background image in the new camera frame 159 in reverse, the user can confirm that the video camera 4 is moving.

On the other hand, if the camera position change command has been transmitted in step 36 (Y), the control unit 11
Furthermore, the camera position of the video camera 4 is changed to the new camera frame 15.
It is determined from the camera position read in step 32 whether or not the camera has moved to the position corresponding to 9 (step 45).
If it is not the camera position after the movement (Step 45; N),
Since the image data converted to the bitmap data in step 34 is not the image data corresponding to the new camera frame 159, the process returns to step 31 to continue receiving the image data corresponding to the new camera frame 159.

If the camera position of the video camera 4 has moved to a position corresponding to the new camera frame 159 (step 4).
5; Y), the control unit 11 returns the display of the background image in the camera frame 159 from the reverse display to the original display (step 4).
6). Then, for the background image file in the RAM 113, the bitmap data at the corresponding position is
The bitmap data updated in step 4 is updated (step 47). Since the background image is captured at the widest angle, the pixel density does not match and the background image file is thinned out at a predetermined interval unless the bitmap data converted in step 34 is imaged at the widest angle. Needs to be updated. In this case, the thinning rate is determined from the zoom value of the background image (the widest angle) and the zoom value of the new camera frame 159. After that, the control unit 11 updates the updated background image with
It is displayed on the background image screen 157 (step 48).

The control unit 11 further monitors whether or not an off process for terminating the process according to the present embodiment has been performed (step 49). If the off process has not been performed (N), the process returns to step 31 to return to the image transmission device. 6 and the remote control of the video camera 4 is continued. On the other hand, if the off process has been performed (step 49; Y), the RAM 11
3 is stored in the storage device 1 based on the background image file stored in the storage device 1.
After the content of the background image file No. 6 is updated (step 50), the processing according to the present embodiment ends.

In the embodiment described above, after the compressed image data received from the image transmission device 6 is expanded and converted into bitmap data, the bitmap data is stored in the background image file in the RAM 113. Alternatively, the received compressed image data may be stored in a background image file in the RAM 113, and then expanded. In the above-described embodiment, the bitmap data of the background image is also stored in the background image file of the storage device 16. However, the compressed image data of the background image is also stored in the background image file of the storage device 16. You may make it.

As described above, according to this embodiment, by sequentially capturing images for each of the divided screens, the entire range that can be captured by the video camera 4 is displayed on the background image screen as a background image. Can accurately determine an area to be confirmed in detail as a main image. Therefore, when image data transmission is relatively slow, unnecessary image transmission / reception due to an error in position designation is eliminated, and image data for an area that the user wants to check can be displayed in the main image window 151 quickly. Further, according to the present embodiment, since the video camera 4 is remotely operated by moving and enlarging / reducing the camera frame displayed on the background image screen 157, the user can easily operate the video camera 4.

Furthermore, according to the present embodiment, the background image file at the corresponding position is updated using the bitmap data of the newly captured main image within the range of the new camera frame. However, the latest background image can be provided to the user. In addition, the background image that is first captured (step 27 in FIG. 7) and the new background image (FIG. 8)
Is stored in the storage device 16,
There is no need to capture a background image every time connection is made with the transmitting station 1, and the remote control of the video camera 4 can be performed immediately.

In this embodiment, since the functions for remotely controlling the video camera 4 of the transmitting station 1 are processed by software, the programs for each function are stored in a recording medium such as a CDROM or a floppy disk. And can be widely provided. Then, by installing the program recorded on the recording medium into a personal computer, each function of the present embodiment can be realized. That is, the image data receiving apparatus of the present embodiment does not require special hardware, and can be easily configured by a personal computer and a recording medium.

For example, a divided image request function for dividing an entire range that can be imaged by a remotely operable imaging device into a plurality of ranges, and sequentially requesting imaging of an image corresponding to each of the divided ranges;
A divided image receiving function for sequentially receiving each of the divided images captured in response to the request by the divided image request function, a combining function for combining the divided images received by the divided image receiving function, and a combining function using the combining function A background image display function of displaying the obtained image as a background image, a position transmission function of transmitting an imaging position of the imaging device, and an image captured at the imaging position transmitted by the position transmission function, and a main image. Main image display function to display as
Can be provided as a recording medium on which a program for causing a computer to realize is stored. Further, an image range display function for displaying, in the background image displayed by the background image display function, an image range corresponding to the main image displayed by the main image display function, the computer realizes an image range display function. The program may be recorded on the recording medium. Further, the image range display function, when a new imaging position is transmitted by the position transmitting means, until an image captured at the new imaging position is received, the image range at the new imaging position, The program may be recorded on the recording medium as a program for distinguishing and displaying the image range corresponding to the main image displayed by the main image display means.

Further, a background image display function for displaying, as a background image, an entire range of images that can be imaged by a remotely operable imaging device, a position transmission function for transmitting an imaging position by the imaging device, and a position transmission function An image receiving function of receiving an image captured at the transmitted image capturing position, a main image display function of displaying an image received by the image receiving function as a main image, and the background image A background image updating function of updating a corresponding range of a background image displayed by the display function may be provided as a recording medium recording a program for causing a computer to realize the background image updating function. Further, an image receiving function of receiving an image from an imaging device having a position control mechanism that can change the position of the image sensor, and a plurality of images captured at different positions of the image sensor, the image receiving function And an image combining function for combining the images into a single image and displaying the combined image on an image display device, and specifying an area that can be imaged from within the display range of the combined image displayed on the image display device by the image combining function. An area designation function to be transmitted to the imaging device, and an image captured by the image sensor corresponding to the area designated by the area designation function, received by the image reception function, and synthesized by the image synthesis function. The image embedding function to be incorporated in the corresponding area of the composite image and the recording medium that records a program for causing a computer to realize the function can also be provided.

[0049]

According to the image data receiving apparatus of the present invention,
It is possible to update a part of the background image without interfering with remote operation of the imaging device on the transmission side.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram of an image data communication system using an image data receiving device according to an embodiment of the present invention.

FIG. 2 is a configuration diagram of a personal computer in a receiving station.

FIG. 3 is an explanatory diagram of a display screen of the display device of the embodiment.

FIG. 4 is an explanatory diagram of each divided screen when a background image is captured.

5A and 5B show changes in a background image screen when a video camera is remotely operated while confirming the entire imageable range with a background image. FIG. 5A shows a screen before a camera frame is changed. , (B) shows a screen in a state where a new camera frame is set,
(C) shows the screen after receiving the main screen corresponding to the new camera frame.

FIG. 6 is a part of a flowchart showing details of a background image capturing operation according to the embodiment;

FIG. 7 is another part of the flowchart showing details of the background image capturing operation according to the embodiment.

FIG. 8 is a part of a flowchart showing details of a camera frame update operation according to the embodiment;

FIG. 9 is another part of a flowchart showing details of the camera frame update operation according to the embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 transmitting station 2 receiving station 4 video camera 5 control unit 6 image transmission device 7, 9 mobile phone 8 modem 10 personal computer 11 control unit 111 CPU 112 ROM 113 RAM 13 keyboard 14 mouse 15 display device 151 main image window 152 camera Control window 153 Full screen capture key 154 Detailed setting key 155 Setting cancel key 156 Setting transmission key 157 Background image screen 158 Camera frame 159 New camera frame 16 Storage device 17 Storage medium drive device 18 Communication control device 19 Input / output IF

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Toshio Takaichi 2-19-12 Sotokanda, Chiyoda-ku, Tokyo Inside Equos Research Inc. (72) Inventor Yukio Yamamoto 2-19 Sotokanda, Chiyoda-ku, Tokyo # 12 Inside Equos Research Co., Ltd. (72) Inventor Toshihiro Mori 2--19-12 Sotokanda, Chiyoda-ku, Tokyo (72) Inside Equos Research Co., Ltd. (72) Inventor Yuki Ishikawa 2, Sotokanda, Chiyoda-ku, Tokyo No. 19-12, Equos Research Co., Ltd.

Claims (1)

[Claims] 1. An image display device, an image receiving means for receiving an image from an imaging device having a position control mechanism capable of changing a position of an imaging device, and a plurality of images taken at different positions of the imaging device Image of
An image synthesizing unit for sequentially receiving the image by the image receiving unit, synthesizing the image into one image, and displaying the image on the image display device; Area designating means for designating a specific area and transmitting the image to the imaging device; receiving an image taken by the image sensor corresponding to the area designated by the area designating means by the image receiving means;
An image incorporation means for incorporation into a corresponding area of the combined image combined by the image combining means.