JPH0638201A - Video telephone set - Google Patents

Abstract

PURPOSE:To reproduce a picture at a sender side immediately after each function key is operated by making a request for uncorrelated data when a prescribed function key is closed and making a request of correlated data when the function key is opened. CONSTITUTION:Received correlated/uncorrelated data are stored in a memory 312, and a current frame picture is reproduced from the stored correlated data and a preceding frame picture already reproduced. The reproduced current data are displayed on a display device 17, and prescribed function keys 15 are used to make a request of holding processing/own picture processing/ transmission pause processing. When the prescribed function key 15 is closed, the transmission of the uncorrelated data is requested and when prescribed function key 15 is opened, the transmission of the correlation data is requested. Since the correlated/uncorrelated data are transmitted on request and the correlated/uncorrelated data are stored in the memory 312, the video recording function is realized without need of special circuit configuration. Moreover, the receiver side reproduces the sender side picture immediately after the operation of the function key 15.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone device,
The present invention relates to a videophone device that realizes various functions such as self-portrait display and recording while receiving image data.

[0002]

2. Description of the Related Art With the widespread use of ISDN (Integrated Services Digital Communication Network), development of video telephone devices using ISDN has been carried out. In addition to a conventional telephone that performs only voice communication, this videophone device is also capable of communicating a self-portrait of the caller and images such as materials. In such a videophone device, the voice input from the handset is encoded, the image of the speaker picked up by a camera equipped with a CCD (Charge coupled device) or the like is compression-encoded, and both are subjected to ISDN communication via the ISDN communication control unit. I try to send from the line. On the other hand, the voice and the image from the "sending side" speaker are also encoded and transmitted, so that they are decoded and the voice is output from the handset, and the decoded image is output to the display.

Here, there is a limit to the amount of data that can be transmitted using the ISDN line, and it is currently 64 Kbit / sec. Therefore, in the current videophone device, although it is a moving image, it corresponds to the characteristic of the image of the videophone device that the previous position such as eyes, mouth, face, etc. is slightly moved.
The quality of the transmitted image is the value set by each manufacturer. Then, the image is picked up by the CCD so as to have the set image quality, or the set image quality is set by thinning out the data picked up by the CCD.
ret cosine transform; after being compressed by various data compression methods such as Huffman coding,
It is sent to the other party via ISDN line together with voice data. Here, when compressing and transmitting image data, a frame correlation method is used in which the first frame is first compressed and transmitted, and the subsequent frames are compressed and transmitted only for differences from the previous frame. is doing. Then, in the case of "frame correlation on", the data compressed with only the slight difference is transmitted, and in the case of "frame correlation off", the image data captured by the CCD is compressed and transmitted as it is.

[0004]

However, the frame correlation method has the following problems. Figure 1
As shown in 1, in the case of the initial frame to be transmitted first, the “transmission side” that transmits the image data transmits the initial frame “0” captured by the image pickup of the CCD as it is to the “reception side” and The frame "0" is stored in the screen memory (step 501). on the other hand,
The "reception side" decompresses the received initial frame "0", stores it in the image memory, and displays it on the screen (step 502). After that, on the "transmission side", in principle, the frame is transmitted with the frame correlation turned on. That is, on the "transmission side", the next captured frame "1"
Is stored in another area of the image memory and the difference Δ01 between the frame “0” and the frame “1” is obtained and transmitted (step 503). And on the "receiving side",
A frame “1” is reproduced and displayed from the received difference Δ01 and the previous frame (frame “0”) stored in the image memory, and the data of this frame “1” is stored in the image memory. (Step 504). As described above, in the state where the frame correlation is on, the “transmission side” continuously transmits the difference Δn−1n from the previous frame “n−1”, and the “reception side” continuously reproduces the reproduced previous frame “n”. The current frame n is sequentially reproduced and displayed from "n-1" and the received difference Δn-1n.

Here, it is assumed that, on the "reception side", of the function keys (function buttons) such as hold, self-portrait, and transmission pause in the key telephone, for example, the self-portrait key is turned on. In this case, the screen X of the self-portrait corresponding to the pressed key is stored in the image memory, and
A self-portrait is displayed on the screen (step 508). However, on the “sending side”, the difference Δ from the previous frame (in FIG. 11, the difference Δ23, regardless of the operation on the “receiving side”).
Δ34, ...) is transmitted. For this reason, when the function key is turned off on the “reception side”, the data stored in the image memory is the self-portrait “X”. The frame "4" intended by the "side" cannot be reproduced, and the self-portrait "X"
There is a problem that the distorted image X ′ is reproduced due to the difference Δ34 based on.

In order to deal with such a problem, it is possible to transmit the initial frame again every time a fixed number of frame correlation data (difference Δ) is transmitted. But,
After the operation of the "reception side" is performed, it is not possible to immediately reproduce the image intended by the "transmission side", and it is necessary to wait until the next initial frame is transmitted. In particular, if there are few errors during image transmission, it is possible to adopt a method of extending the transmission interval of the initial frame,
When this system is adopted, there is a problem that it takes a long time to reproduce the image intended by the transmitting side after the function key is turned off. Also, the initial frame transmission is
Since it is necessary to transmit a large amount of data compared to the transmission of the difference Δ, the initial frames are transmitted at regular intervals even if the operation on the “reception side” is not performed at all,
The data transmission efficiency was poor.

On the other hand, in such a frame correlation method,
The current frame is reproduced from the received frame correlation data and the reproduced previous frame and displayed on the display. However, the image data of the reproduced previous frame and the current frame is incorporated in the unit that reproduces, and special processing and circuits were required to take out the reproduced frame. Therefore, there is a problem that the circuit configuration and the processing become complicated in recording the image data of the "sending side".

Therefore, according to the present invention, during transmission from the transmitting side,
It is a first object of the present invention to provide a videophone capable of reproducing an image on the transmitting side immediately after operating various function keys on the "receiving side". A second object of the present invention is to provide a videophone device that realizes a recording function without requiring a special circuit configuration.

[0009]

According to a first aspect of the invention, each frame image has a camera for photographing an image, a compression / reproduction unit for compressing and reproducing the image, and a display for displaying the reproduced image. A videophone that transmits and receives correlation data obtained by taking the difference between them, reproduces the current frame image from the reproduced previous frame image and the received correlation data, and displays it on the display.
A data receiving means for receiving non-correlated data, a memory for storing the correlated and non-correlated data received by the data receiving means, a current frame image from the correlation data stored in this memory and the reconstructed previous frame image And a display unit for displaying the current frame reproduced by the reproduction unit, a predetermined function key for requesting hold processing, self-portrait processing, and transmission pause processing, and when the predetermined function key is turned on. Request to send uncorrelated data to O
A request means for requesting transmission of correlation data in the case of FF is provided in the videophone device to achieve the first object.

According to the second aspect of the present invention, a camera for photographing an image, a compression / reproduction unit for compressing and reproducing the image, and a display for displaying the reproduced image are provided, and a difference between each frame image is taken. A videophone that transmits and receives correlation data, reproduces the current frame image from the reproduced previous frame image and the received correlation data and displays it on the display, and receives correlated and uncorrelated data from the ISDN line. Receiving means, a memory for storing the correlated and uncorrelated data received by the data receiving means, a reproducing means for reproducing the current frame image from the correlated data and the reproduced previous frame image stored in the memory, and Display means for displaying the current frame reproduced by the reproducing means, recording key for requesting recording, and this recording key is ON
In the case where the video telephone device is equipped with request means for requesting the transmission of the uncorrelated data and recording means for recording the non-correlated data stored in the memory and transmitted by the request of the request means, The second object is achieved.

[0011]

According to the invention of claim 1, when various function keys are turned on at the "reception side" while receiving image data from the "transmission side" videophone device, a screen display corresponding to the function is displayed. Processing is done. In this case, the frame correlation OFF command signal is transmitted to the "transmission side", the frame correlation OFF data is transmitted from the "transmission side", and this is separately stored as a reproduced previous frame. By doing this, when the function key is turned off on the "reception side", the image of the "reception side" until then (for example, the self-portrait)
Then, the current frame can be immediately reproduced from the frame correlation OFF data stored as the reproduced frame, without overlapping the frame correlation ON image from the “transmission side”. According to the second aspect of the present invention, if the recording key is turned on at the "reception side" while receiving image data from the "transmission side" videophone device, a command for frame correlation OFF is given to the "transmission side". Send signal, "sender"
To transmit data with frame correlation OFF. On the "reception side", the transmitted frame correlation OFF data is recorded.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the videophone device of the present invention will be described in detail below with reference to FIGS. FIG. 1 shows an external configuration of the videophone device, and FIG. 2 shows its circuit block. As shown in FIG.
0 has a base portion 11, a handset 12 is arranged on the left side of the base portion 11, and a display support portion 13 is arranged on the right side.

The telephone handset 12 has a microphone and a speaker (not shown). A speaker 14 and various operation keys 15 are arranged on the upper surface of the base 11. The operation keys 15 include a speaker volume knob 151 for adjusting the volume of the speaker 14, a handset volume knob 152 for adjusting the volume of the handset 12, various function keys 153 associated with the telephone function, a numeric keypad 154 for dialing, and a television function. There are a recording key 155, a privacy key 156 for not transmitting the self-portrait to the other party, a menu screen key 157 for displaying a menu such as various mode settings, and the like.

A camera 16 composed of, for example, a CCD is arranged in the upper right portion of the front surface of the display support 13.
Take a picture of the speaker. Further, a display 17 for displaying an image is provided on the handset 12 side of the display support 13.
Is attached. On the display 17, an image of the other party transmitted from the videophone device of the other party is displayed, and a menu screen is displayed according to various modes designated by the operation of the operation keys 15, and the camera is also displayed. For example, the image captured in 16 and transmitted to the other party is displayed by combining with the image of the other party, and further, a predetermined message sentence or icon (pictogram) is displayed alone or by combining with the image. Various displays are made.

A VT (not shown) is provided on the back side surface of the base portion 11.
VTR connection terminals 25a to 25d for connecting R26
(See FIG. 2) are arranged. A camera switching key 18 for switching between the VTR 26 connected to the connection terminal 25 and the camera 16 mounted on the videophone device 10.
Is arranged on the right side surface of the display support portion 13. Further, on the right side surface of the display support portion 13, a shooting condition switching key 19 for switching shooting conditions such as an aperture according to the brightness of a room shot by the camera 16, a color of an image displayed on the display 17 (RGB ) For adjusting the color adjustment knob 20 and the cap 21 are arranged at predetermined positions. The cap 21 is for covering a screw (not shown) for fixing the display 17 to the display support 13. The display 17 is attached by a biasing force toward the display supporting portion 13 by a spring so as to be vertically rotatable about the center of the cap 21.

As shown in FIG. 2, the videophone device 10 is used.
Includes a central processing unit 31. This central processing unit 31
Is a well-known CPU (central processing) that performs various controls.
unit) 311 and a memory 312 including a ROM storing various programs and data for communication and a RAM as a working memory storing various data. The RAM of the memory 312 is set by operating the function keys 153 and the numeric keypad 154, for example,
The number of the other party who can receive in the incoming call restriction mode that limits incoming calls other than the specified caller, speed dial, and
Various data such as various flags indicating states such as standby, outgoing call, incoming call, and communication are stored. In addition, the memory 31
The RAM 2 has an area in which image data of each frame transmitted via the ISDN line and the communication control block 33 is temporarily stored, and a frame to be transmitted is in a state of frame correlation ON or OFF. An area for storing command data indicating whether or not to transmit data is secured. The central processing unit 31 also includes a chip set 313 as a communication interface, and a key controller 314 that controls instruction signals input from various keys of the operation keys 15.

A communication control unit 3 is provided to the central processing unit 31 via a bus line (ISA bus) 32 such as a data bus.
3 and the image processing unit 34 are connected. Also,
Through the ISA bus 32, various information processing devices such as a personal computer, CAD (computer aided design), DTP (desk top publishing) and the like can be connected. The communication control unit 33 includes an ISDN connection terminal 331 and is connected to the ISDN line. The communication control unit 33 controls transmission and reception of data such as communication control signals, voice data, image data and the like. The image processing unit 34 communicates the image data supplied from the camera 16 or the VTR 26 with the image reproduction unit 341 that reproduces the compressed image data transmitted from the videophone device of the other party via the communication control unit 33. An image compression unit 342 that performs compression processing for transmission by the control unit 33 is provided.

The videophone 10 further includes a D / A (digital / analog) converter 36 connected to the image processor 34, an image combiner 37 connected to the D / A converter 36, and an image combiner. An audio control unit 38 connected to the unit 37 and the communication control unit 33 is provided. The audio control unit 38 includes a handset 12,
The speaker 14, the audio input / output terminals 25a and 25c of the VTR connection terminal 25, and the chip set 313 are connected. The audio control unit 38 is configured to switch audio, hold sound, and DTMF (dual tone multiplex fr
frequency), and adjusts the volume of the speaker 14 and the handset 12.

The D / A conversion section 36 converts the image data reproduced by the image reproduction section 341 of the image processing section 34 from a digital signal to an analog video signal (NTSC; national tel).
D / A section 36 to convert to an evision system committee)
1 and A / D for converting an analog video signal supplied from the image synthesizing unit 37 into digital image data
A section 362 is provided. The digital image data converted by the A / D unit 362 is the image compression unit 3 of the image processing unit 34.
42.

The image synthesizing section 37 includes an amplifier (AMP) 37.
1, picture-in-picture section 372, AMP3
73 and a changeover switch section 374, which are connected to the video input / output terminals 25b and 25d of the VTR connection terminal 25 and the display 17. The AMP 371 amplifies the analog video signal captured by the camera 16 or the analog video signal supplied from the VTR 26 via the VTR connection terminal 25b. The selection of both video signals is determined by the connection state of the changeover switch unit 374 by the changeover operation of the camera changeover key 18 in FIG. AM
The analog video signal amplified by P371 is usually A
It is supplied to the A / D unit 362 and is supplied to both the A / D unit 362 and the picture-in-picture unit 372 when the image combining function is designated by the operation key 15.

Picture-in-picture section 372
AMPs the image data supplied from the D / A unit 361.
Supply to 373. Further, when the image synthesizing function is designated by the operation key 15, the video signal supplied from the D / A unit 361 (the image signal transmitted from the videophone device on the other end of the call) and the AMP 371 are supplied. Video signal (self-portrait or V captured by camera 16)
The video signal supplied from TR26) and the operation key 1
According to the designated state of 5, the synthesized video signal is A
Supply to MP373. AMP373 supplied NT
The SC signal is amplified and supplied to the display 17. The display 17 displays the supplied video signal in color.

FIG. 3 shows a circuit configuration in the image processing section 34. As shown in FIG. 3, the image reproducing unit 3 of the image processing unit 34.
Reference numeral 41 stores a first-in first-out FIFO memory 341a for storing the image data supplied from the ISA bus 32, a Huffman decoding unit 341b for Huffman decoding the image data in the FIFO memory 341a, and the decoded image data. The block memory 341c and the compression reproduction unit 341d that reads out image data stored in the block memory 341c and reproduces image data compressed by motion compensation inter-frame prediction, DCT, or the like are provided.

The block memory 341c has an area for two frames, alternately stores the Huffman-decoded image data, and the area not storing the image data (the area of the previous frame) The image data is read out from the area where the image data is stored) and is compressed and reproduced.

On the other hand, the image compression section 342 has a setting parameter storage section 342a in which parameters for setting image quality are stored, a block memory 342b in which digital image data supplied from the D / A conversion section 36 is stored, A compression unit 342c that compresses the image data stored in the block memory 342b by motion compensation inter-frame prediction, DCT, etc., a Huffman coding unit 342d that further Huffman-codes the compressed image data, and a buffer memory 3
42e. The setting parameter storage unit 342a stores I
It is connected to the CPU 311 via the SA bus 32, and when the caller designates the image quality, each parameter designated by the caller or the other party's speaker is stored.
It is automatically set and changed by an instruction from 311.

Next, the operation of the embodiment thus constructed will be described. First, the normal operation of the videophone device will be described. (1) Operation of Main Routine FIG. 4 shows the operation of the main routine. First, the main operation of the main routine will be described. That is, the CPU 311
Each state FG (flag) of the memory 312 is detected, each process is performed, and in the process, the predetermined state FG is changed to shift to the next process or the previous process.
That is, normally, the waiting process is repeated to monitor the outgoing call or incoming call, and when the outgoing call or incoming call is detected, a predetermined FG is changed, and then the process shifts to the corresponding process. In the outgoing call and incoming call processing, when normal processing is performed, the processing shifts to in-communication processing. Then, when the in-communication process ends, or when a specific operation or the like is performed in the incoming or outgoing call process, the process returns to the waiting process and the outgoing or incoming call is monitored again.

Next, the details of the main routine are shown in FIG.
Follow the instructions below. That is, when the videophone device 10 is installed, the ISDN board (communication control unit 33), the image processing board (image processing unit 34), the keyboard (operation keys 15), and the image composition board (picture-in board).
The picture section 372) is initialized and various memory areas are initialized (step 10). Then, the operator of the videophone device operates the function key 153 and the numeric keypad 1
When the operation keys such as 54 are processed (step 11), C
The PU 311 shifts to DI / O processing and accepts output of control signals to each board and supply of status signals from each board (step 12).

Then, the CPU 311 accesses the flag storage area of the RAM 312 in the memory 312, confirms whether any of the flags is in the ON state, executes the process corresponding to the flag in the ON state, and goes to a predetermined portion. The instruction signal of is output. That is, the CPU 311 shifts to the standby process when the standby FG is ON (step 13) (step 14), and shifts to the outgoing call process when the outgoing FG is ON (step 15) (step 16). When the incoming FG is ON (step 17), the incoming call process is performed (step 18), and when the communicating FG is ON (step 19), the incoming call process is performed (step 2).
0). Then, when all the flags are OFF, and after any of the processes from step 14 to step 20 is completed, the process returns to step 11 to continue the process.

As described above, the videophone includes the standby process, the outgoing call process, the incoming call process, and the in-communication process. In this embodiment, however, the communication process is the main point.
Only the in-communication processing will be described in detail, flowcharts of other processing will be shown in FIGS. 6 to 7, and description thereof will be omitted.

FIG. 8 shows the basic processing of the in-communication processing, and the gist of this embodiment relates to the image communication processing of step 205. (2) Basic processing during communication FIG. 8 shows the basic operation of the processing during communication. In the in-communication process, the in-communication FG is changed to the ON state in the incoming-call process of FIG. 7 (step 190), and the in-communication FG is changed to the ON state in the outgoing-call process of FIG. 6 (step 176). , Starts the process. First, CP
The U 311 monitors whether or not the calling party has issued a communication disconnection request to the communication control unit 33 via the ISDN line (step 201). If there is no disconnection request (step 201; N), the handset 12 is on-hook (step 202; Y), and if the hold key or the speaker key is pressed in advance (step 203; Y), hold, send pause. Each effective functional process is performed even during a call (step 204).

Note that each function process includes a holding process, a transmission pause process, a privacy process, a recording process, a menu process, and a self-portrait process. Hold processing ... When the hold key of the function keys 153 is pressed, the hold screen is displayed.
7 and the hold screen data is sent from the communication control unit 33 to the IS
Send to DN line. The hold screen data is previously stored in the camera 1.
The image data captured in 6 or supplied from the VTR 26 is stored in the RAM of the memory 312, and this image data is read and used. When the hold screen setting is the default (the one prepared as standard and not rewritable), only the hold code is transmitted, and the side receiving the code displays the default screen on the display 17. Send pause process ... When the send pause key is selected, the camera 16
A screen having no correlation with the previous frame is captured from the image data supplied from the above and displayed on the display 17, and the image data is transmitted from the communication control unit 33 to the other party. Further, the display 17 displays an icon indicating the paused state.

Privacy processing ... Privacy key 15
When 6 (FIG. 1) is pressed, the corresponding code is transmitted to the other party of the call via the communication control unit 33, and the icon indicating the privacy state is displayed on the display 17
To display. On the other hand, in the videophone that has received the privacy code, the privacy screen is displayed on the display 17. Recording process: When the recording key 155 is pressed, the image data transmitted from the "transmission side" is recorded, as described later. Menu processing ... Menu screen key 15
When 7 is pressed, a recording medium selection icon is displayed on the display 17, and one-shot recording for recording a screen of only a specific frame or tape selection becomes possible. In the case of one-shot recording, when a request to send image data that does not have frame correlation is issued to the other party's videophone and image data that does not have correlation is received, the image data that remains compressed or decryption is performed. The data after reproduction is stored in the memory 312.

Self-portrait processing ... When self-portrait processing is selected,
On the display 17, not the image data transmitted from the other party's videophone but the self-portrait photographed by the camera 16 or the VTR 26 is displayed on the display 17. The caller sets and changes the screen size and the image quality mode while looking at the self-portrait displayed on the display 17. This image quality mode includes a designated image quality mode in which image data is transmitted at a designated constant image quality, and an automatic image quality mode in which the movement of the image data is monitored and an appropriate image quality of the self image according to the movement is selected.

After the above functional processing is completed, image communication processing is performed (FIG. 8, step 205). That is, IS
When the DN board (communication control unit 33) is in the data transmission OK state, the image data is fetched, and a communication header is attached to each transmission block and transmission is performed from the communication control unit 33. If the communication control unit 33 has received data, the received image data is received, and the image data is received by the image processing unit 34, the D / A conversion unit 36, and the image synthesis unit 3.
Image data for one frame is displayed on the display 17 via 7. The received voice data is output to the handset 12, the speaker 14, or the VTR connection terminal 25a via the audio control unit 38. In step 202, when the handset 12 is in the off-hook state (step 202; N), the operation key 1
It is determined whether or not a predetermined key input is made from step 5 (step 206). When key input is made (step 20)
6; Y), the processing shifts to each functional processing of step 204,
If no key is input (step 206; N),
The process proceeds to the image communication process of step 205.

On the other hand, in step 201, a disconnection request is issued from the other party (step 201; Y) and if it is normally completed (step 207; Y), or in step 203, both the hold key and the speaker key are pressed. If it has not been pressed in advance (step 203; N), C
The PU 311 performs communication end processing (step 20).
8). That is, as the communication end processing, the handset 1
The videophone device on the side that hooked 2 sends a disconnection message to the voice line, and sends a disconnection message to the data line when release is returned. On the other hand, the videophone device on the disconnected side transmits a data disconnection message when receiving the audio disconnection message. Here, the display 17 on the calling side displays the charge and the call time, and the display 17 on the receiving side displays only the call time.

After that, the CPU 311 turns the communicating FG in the ON state into the OFF state and changes the waiting FG in the OFF state into the ON state (step 209), and thereafter, by the return processing, the waiting processing in FIG. Go to (Step 14). At step 207, as in the case where an error occurs in the image data line, if the process is not completed normally (step 207; N), communication error processing is performed (step 210). That is, as the communication error processing, the line of the image data is disconnected and only the voice communication is performed.
In this case, the display 17 displays only a predetermined image stored in the RAM in advance and a message indicating that there is a communication error.

Image Communication Process According to the Gist of the Present Embodiment FIGS. 9 and 10 show a flowchart of a part of the process during communication, which is relevant to the gist of the present invention. FIG. 9 shows a display changing process when a display image is changed by turning on a predetermined function key such as hold, self-portrait, and transmission pause key, and FIG. 10 shows a recording process at the time of recording. is there. In this image communication process, data is transmitted and received between the two videophone devices by the "transmission side" videophone device and the "reception side" videophone device. The explanation of the processing operation in the apparatus is shown in FIG.
Will be used to explain.

(A) Display Change Process (FIG. 9) First, the outline of the display change process will be described. That is, in normal transmission / reception, the "transmission side" transmits the difference Δ between the previous frame and the current frame as frame correlation ON data (correlation data), and the "reception side" transmits the reproduced previous frame and frame correlation ON data. To reproduce the current frame. Here, on the "reception side", the self-portrait key is O
When it is N, the frame correlation OFF command is transmitted, and the "transmission side" subsequently transmits the frame correlation OFF data.
On the "reception side", this frame correlation OFF data (non-correlation data) is separately stored as a reproduced previous frame. Then, when the self-portrait key is released, the “reception side” transmits a frame correlation ON command, and the “transmission side”
Then, when the ON command is received, the frame correlation is turned ON again.
Send data to "receiver". The "reception side" reproduces the current frame from the frame correlation OFF data stored as the reproduced previous frame and the frame correlation ON data.

Next, details of the display changing process will be described with reference to FIG. As shown in FIG. 9, on the “transmission side”, after transmitting the initial frame, image transmission processing is performed on the image captured by the camera 16. That is,
On the "sending side", the current frame captured by the camera 16 is stored in the area of the block memory 342b in which the previous frame is stored, the previous frame is read from the other area, the difference Δ is calculated, and the frame correlation ON data is acquired. As a result, the data is transmitted to the "reception side" via the communication control unit 33 and the ISDN line (step 301).

On the other hand, on the "reception side", the frame correlation is ON.
When data is received, data reception processing is performed. That is, on the "reception side", the ISDN line and the communication control unit 3
The frame correlation ON data received via 3 is stored in the RAM of the memory 312 in the central processing unit 31. Then, the frame correlation ON data stored in the RAM is compressed and reproduced by the image reproducing unit 341, the reproduced data is stored in the area of the block memory 341c in which the previous frame is stored, and the previous frame is read from the other area. Then, the current frame is reproduced (step 302) and D / A
The display 17 is displayed via the conversion unit 36 and the image composition unit 37.
(Step 303).

On the "reception side", while continuing the above data reception processing and screen display, it is monitored whether or not a caller has turned on a predetermined function key such as hold, self-portrait, and transmission pause (step 304). . Here, when the predetermined function key is turned on on the "reception side" (step 30)
4; Y), the "reception side" requests transmission of data having no frame correlation, and therefore transmits a frame correlation OFF command to the "transmission side" (step 305). This command is transmitted as follows. That is, when the composition of the transmission frame is the communication header section and the image data section, and when the self-portrait key etc. is turned on, the frame correlation OFF command is set in the communication header section, and the correlation and decorrelation from the "reception side" Send with the data. This is similarly performed when the frame correlation ON command is transmitted. Now, the following description will be given assuming that the self-portrait key is turned on as the predetermined function key. Then, the self image data captured by the camera 16 is alternately stored in both areas of the block memory 341c of the image reproducing unit 341 in accordance with the turned-on function key, and this is displayed on the display (step 306).

On the other hand, on the "transmitting side", the frame correlation is ON.
While continuously transmitting data, the reception of the frame correlation OFF command is monitored (step 307). Then, when the frame correlation OFF command in step 305 is received from the "reception side" (step 307;
Y), the "sending side" stores the received command in the memory 31
It is stored in the second RAM (step 308). After this,
On the “transmission side”, frame correlation OFF data is transmitted. That is, the current frame captured by the camera 16 is directly compressed by the image compression unit 342 without taking the difference from the previous frame, and the communication control unit 33 and the ISDN are processed.
Send to "receiver" via line (step 30)
9).

On the "reception side", the data reception process, that is, the received frame correlation OFF data is stored in the memory 312.
Processing for storing in the RAM (step 310). Then, it continues to monitor whether or not the predetermined function key turned on in step 304 has been released, and while it is in the on state (step 311; N), the received frame correlation OFF data is sequentially updated in the RAM of the memory 312. Store and save.
During this period, the image compression unit 34 is displayed on the display 17.
The self-portrait data stored in the first block memory 341c continues to be displayed.

When the predetermined function key which has been turned on is released (step 311; Y), the "reception side" reproduces the frame correlation OFF data stored in the RAM of the memory 312 while sequentially updating the image. While compressing and reproducing in the unit 341 and storing in the block memory 341c,
It is displayed on the display 17 (step 312). In this way, the image corresponding to the predetermined function key is displayed on the display 1.
7, the frame of the “sending side” can be immediately displayed on the display 17 when the function is canceled.

On the "reception side", the frame function ON command is transmitted to the "transmission side" via the communication control unit 33 and the ISDN line by releasing the ON predetermined function key (step 313). By the return processing, the process proceeds to step 302. On the other hand, the "transmission side" monitors the reception of the frame correlation ON command while continuously transmitting the frame correlation OFF data (step 31).
4). Then, the frame correlation O in step 313
When the N command is received from the "receiving side" (step 31)
4; Y), on the "sending side", after changing the OFF command stored in the RAM of the memory 312 to the ON command (step 315), the return process is executed to step 3
Move to 01. After that, the data with the frame correlation ON is transmitted.

(B) Recording Process (FIG. 10) As shown in FIG. 10, on the “transmission side”, after transmitting the initial frame, the image transmission process is performed on the image captured by the camera 16, and the frame correlation is performed. The ON data is transmitted to the "reception side" (step 401). On the other hand, on the "reception side", when the frame correlation ON data is received, the current frame is reproduced by the data reception process (step 4).
02) and display it on the display 17 (step 40)
3). The details of each process of steps 401 to 403 are the same as steps 301 to 303 described in FIG.

The "reception side" monitors whether or not the recording key 155 (FIG. 1) is turned on by the caller while continuing the above data reception processing and screen display (step 404). On the "receiving side", the recording key mode 155
Is turned on (step 404; Y), the frame correlation OFF command is transmitted to the "transmission side" (step 4).
05).

On the other hand, on the "transmitting side", the frame correlation is ON.
While continuously transmitting data, the reception of the frame correlation OFF command is monitored (step 406). Then, when the frame correlation OFF command in step 405 is received from the "reception side" (step 406;
Y), the "sending side" stores the received command in the memory 31
It is stored in the second RAM (step 407). After this,
On the “transmission side”, frame correlation OFF data is transmitted. That is, the current frame captured by the camera 16 is directly compressed by the image compression unit 342 without taking the difference from the previous frame, and the communication control unit 33 and the ISDN are processed.
It is transmitted to the "reception side" via the line (step 40).
8).

On the "reception side", data reception processing is performed.
That is, the received frame correlation OFF data is stored in the RAM of the memory 312 and is stored in both areas of the block memory 341c of the image reproducing unit 341 (step 409), and the image of the reproduced frame is displayed on the display 17. (Step 410). Further, the "reception side" continues to monitor whether or not the recording key 155 is turned on again, and while it is not turned on (step 411; N),
The received frame correlation OFF data is sequentially updated and stored in the RAM of the memory 312, and the reception screen is displayed (steps 409 and 410). During this time,
Since the frame correlation OFF data from the “transmission side” is not the data based on the difference Δ from the previous frame, the data amount is very large. Therefore, the display 17 displays frame-by-frame image data that changes at every fixed time when the reception of the frame correlation OFF data from the "transmitting side" is completed. This means that the image data of a certain frame displayed on the display 17 continues to be displayed for a certain period of time, so that the caller can easily select a desired frame for recording.

When the recording mode key 155 is turned on again by the caller (step 411; Y),
On the "reception side", recording processing of the frame correlation OFF data stored in the RAM of the memory 312 is performed. That is, the frame correlation OFF data stored in the RAM of the memory 312 is stored in another storage area, or
The data is stored in an external storage device (not shown) such as a floppy disk or a hard disk via the ISA bus 32 (step 412). Further, on the "reception side", when the recording key 155 is turned on, the frame correlation ON command is transmitted to the "transmission side" via the communication control unit 33 and the ISDN line (step 413), and then the return processing is performed to step 402. Move to.

On the other hand, on the "transmitting side", the frame correlation OF
While continuously transmitting the F data, the reception of the frame correlation ON command is monitored (step 414). When the frame correlation ON command in step 413 is received from the "reception side" (step 414; Y),
On the "sending side", after changing the OFF command stored in the RAM of the memory 312 to the ON command (step 415), the process proceeds to step 401 by the return process. After that, the data with the frame correlation ON is transmitted.

[0051]

According to the video telephone apparatus of the first aspect, when various function keys are turned on at the "reception side",
When the predetermined function key is turned on, the non-correlation data transmission is requested, and when the predetermined function key is turned off, the correlation data transmission is requested. Therefore, immediately after the operation of the various function keys on the "reception side", It is possible to reproduce the image on the transmission side. Further, according to the videophone device described in the claims, when the recording key is turned on, the transmission of the decorrelation data is requested, and the decorrelation data transmitted by the request of the requesting unit and stored in the memory is stored. Since the image is recorded, the recording function is realized without requiring a special circuit configuration.

[Brief description of drawings]

FIG. 1 is an external configuration diagram of a videophone device according to an embodiment of the present invention.

FIG. 2 is a circuit configuration diagram of the videophone device of the above.

FIG. 3 is a block diagram showing details of an image processing unit of the above.

FIG. 4 is a flowchart showing the operation of the main routine of the videophone device of the above.

FIG. 5 is a flowchart showing the operation of the standby processing of the videophone device.

FIG. 6 is a flowchart showing an operation of a calling process of the videophone device.

FIG. 7 is a flowchart showing the operation of the incoming call processing of the videophone device.

FIG. 8 is a flowchart showing the operation of the process during communication of the videophone device.

FIG. 9 is a flowchart of a first example of an operation according to the gist of an example in the communication process.

FIG. 10 is a flowchart of a second example of the operation according to the gist of the example in the communication process.

FIG. 11 is an explanatory diagram showing an inconvenience in a conventional videophone device.

[Explanation of symbols]

 10 videophone device 11 base unit 12 handset 13 display support unit 15 operation keys 17 display 31 central processing unit 311 CPU 33 communication control unit 34 image processing unit 36 D / A conversion unit 37 image synthesizing unit 38 audio control unit

Claims (2)

[Claims] 1. A camera for photographing an image, a compression / reproduction unit for compressing and reproducing the image, and a display for displaying the reproduced image, and transmitting / receiving correlation data taking a difference between each frame image, A video phone that reproduces the current frame image from the reproduced previous frame image and the received correlation data and displays it on the display, and data receiving means for receiving correlated and uncorrelated data from the ISDN line, and this data. A memory for storing the correlated and uncorrelated data received by the receiving means, a reproducing means for reproducing the current frame image from the correlated data stored in this memory and the reproduced previous frame image, and the reproducing means for reproducing the current frame image. The display means for displaying the current frame on the display, the predetermined function key for requesting the holding process, the self-portrait process, the transmission pause process, and the predetermined function key A video telephone device comprising: a request unit that requests transmission of uncorrelated data when turned on and a request of transmission of correlated data when turned off. 2. A camera for taking an image, a compression / reproduction unit for compressing and reproducing the image, and a display for displaying the reproduced image, and transmitting / receiving correlation data taking a difference between each frame image, A video phone that reproduces the current frame image from the reproduced previous frame image and the received correlation data and displays it on the display, and data receiving means for receiving correlated and uncorrelated data from the ISDN line, and this data. A memory for storing the correlated and uncorrelated data received by the receiving means, a reproducing means for reproducing the current frame image from the correlated data stored in this memory and the reproduced previous frame image, and the reproducing means for reproducing the current frame image. Display means for displaying the current frame on display, a recording key for requesting recording, and requesting transmission of uncorrelated data when this recording key is turned on. A videophone device, comprising: a requesting means for performing the request, and a recording means for recording the non-correlated data stored in the memory and transmitted by the request of the requesting means.