JP2000353238A - Image processing system, control method therefor, image processing apparatus, control method therefor, and storage medium - Google Patents

Abstract

(57) [Summary] An image processing system capable of reducing the amount of data to be transmitted is provided. An image processing apparatus having an image sensor and a display device for displaying at least image information, an information processing apparatus for processing information, and performing communication between the image processing apparatus and the information processing apparatus. Communication units 112 and 41
8, wherein the image processing apparatus 100 transmits information related to the image data to the information processing apparatus 40.
0, and the information processing apparatus 400 transmits the image information in the first state, which has been processed according to the received information from the image processing apparatus, to the image processing apparatus 100.
Displays the received image information in the first state together with the image information captured by the image sensor on the display device, captures the image information in the second state, and transmits the captured image information to the information processing device 400.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing system which captures, records, reproduces, and communicates a still image and a moving image, a control method thereof, an image processing apparatus, a control method thereof, and a storage medium.

[0002]

2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera for recording and reproducing a still image or a moving image and an image for communicating a recorded image to an information processing apparatus such as a computer using a memory card having a solid-state memory element as a recording medium. Processing systems are already commercially available, and image processing systems using an electronic camera equipped with an electronic finder such as a color liquid crystal panel are also sold.

According to these image processing systems, a user of an electronic camera determines a composition by continuously displaying images before photographing, and reproduces and confirms photographed images and communicated images. It is possible.

[0004]

In such an image processing system of a conventional electronic camera or the like, an image obtained by synthesizing an image transmitted from a computer and an image photographed by the electronic camera is created, When creating an image that combines a captured image and a captured image, image communication between the computer and the electronic camera goes back and forth, so the amount of image data to be communicated increases, communication time increases, and communication costs increase. There was a problem that

In this case, first, one image data to be synthesized is transmitted from the computer to the electronic camera, and the electronic camera displays the received image data together with the image before photographing on the electronic viewfinder, and transmits the photographed image data and the computer. After combining the combined image data, the combined image data is sent back to the computer.

Therefore, the amount of image data transmitted from the computer to the electronic camera and the amount of image data transmitted from the electronic camera to the computer are both the amount of image data of the image sensor provided in the electronic camera or the amount of image data corresponding to the imaging mode. Therefore, there is a problem that the communication time increases and the communication cost increases due to an increase in the amount of image data to be communicated.

Accordingly, the present invention has been made in view of the above-described problems, and has as its object to provide an image processing system capable of reducing the amount of data to be transmitted, a control method therefor, an image processing apparatus, a control method therefor, and the like. The purpose is to provide a storage medium.

[0008]

Means for Solving the Problems The above-mentioned problems are solved,
In order to achieve the object, an image processing system according to the present invention includes an image processing apparatus having an imaging unit, a display unit that displays at least image information, an information processing apparatus that processes information, and the image processing apparatus. And a communication unit for performing communication between the information processing apparatus, wherein the image processing apparatus transmits information related to image data to the information processing apparatus, and the information processing apparatus receives the received information. The first that performed processing according to the information from the image processing device
Transmitting the image information of the state to the image processing apparatus, the image processing apparatus, the received image information of the first state,
The image information is displayed on the display unit together with the image information captured by the image capturing unit, and the image information in the second state is captured and transmitted to the information processing apparatus.

In the image processing system according to the present invention, the information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit. Is a state of the pixel configuration corresponding to the information on the pixel configuration of the display means, and the second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the imaging means.

In the image processing system according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is It is characterized by information on the number of vertical and horizontal pixels of the imaging means.

In the image processing system according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of image data displayed on the display means, and The information about the image data is information on the number of vertical and horizontal pixels of the image data captured by the image capturing unit.

In the image processing system according to the present invention, the first state is a state corresponding to a data amount of an image to be displayed on the display means, and the second state is an image taken by an image pickup means. It is characterized in that it is in a state corresponding to the data amount of the image.

An image processing apparatus according to the present invention has an image pickup means and at least a display means for displaying image information, and is capable of communicating with an information processing apparatus for processing information. Transmitting information related to image data to the information processing apparatus, and receiving image information in a first state in which the information processing apparatus has performed processing according to the transmitted information related to the image data. Displaying the received image information in the first state together with the image information captured by the imaging unit on the display unit, capturing the image information in the second state, and transmitting the captured image information to the information processing apparatus. Features.

In the image processing apparatus according to the present invention, the information transmitted from the image processing apparatus is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit. The second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the imaging unit, and the second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the display unit.

In the image processing apparatus according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is It is characterized by information on the number of vertical and horizontal pixels of the imaging means.

In the image processing apparatus according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of image data displayed on the display means, and The information about the image data is information on the number of vertical and horizontal pixels of the image data captured by the image capturing unit.

In the image processing apparatus according to the present invention, the first state is a state corresponding to a data amount of an image displayed on the display means, and the second state is an image taken by an image pickup means. It is characterized in that it is in a state corresponding to the data amount of the image.

Further, a control method of an image processing system according to the present invention is directed to an image processing apparatus having an image pickup means, at least a display means for displaying image information, an information processing apparatus for processing information, An image processing system control method for controlling an image processing system comprising a communication device for performing communication between the image processing apparatus and the information processing apparatus, wherein the image processing apparatus stores information related to image data in the information processing apparatus. The information processing apparatus transmits the first state image information processed according to the received information from the image processing apparatus to the image processing apparatus. The image information in the first state is displayed on the display unit together with the image information captured by the imaging unit, and the image information in the second state is captured by image capturing in the second state. It is characterized in that is sent to the location.

In the method for controlling an image processing system according to the present invention, the information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and Is a state of a pixel configuration corresponding to information on a pixel configuration of the display unit, and the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. I have.

In the control method for an image processing system according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is provided. Is information on the number of vertical and horizontal pixels of the imaging means.

In the control method for an image processing system according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of image data displayed on the display means. The information on the pixel configuration is characterized by information on the number of vertical and horizontal pixels of the image data captured by the image capturing means.

In the method for controlling an image processing system according to the present invention, the first state is a state corresponding to an amount of data of an image to be displayed on the display means, and the second state is an image pickup means. Is characterized by a state corresponding to the data amount of the image picked up by.

Further, the control method of the image processing apparatus according to the present invention has an image pickup means and at least a display means for displaying image information, and is capable of communicating with an information processing apparatus for processing information. A method of controlling an image processing apparatus for controlling an image processing apparatus, wherein information related to image data is transmitted to the information processing apparatus, and the information processing apparatus is configured to transmit information related to the transmitted image data. Receiving the processed image information in the first state;
The image information in the second state is displayed on the display unit together with the image information captured by the image capturing unit, and the image information in the second state is captured and transmitted to the information processing apparatus.

In the method of controlling an image processing apparatus according to the present invention, the information transmitted from the image processing apparatus is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and The state is a state of a pixel configuration corresponding to information on a pixel configuration of the display unit, and the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. .

In the method of controlling an image processing apparatus according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is provided. Is information on the number of vertical and horizontal pixels of the imaging means.

In the control method for an image processing apparatus according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of image data displayed on the display means, and The information on the pixel configuration is characterized by information on the number of vertical and horizontal pixels of the image data captured by the image capturing means.

In the method for controlling an image processing apparatus according to the present invention, the first state is a state corresponding to a data amount of an image displayed on the display means, and
The state is characterized by a state corresponding to the data amount of the image captured by the imaging unit.

Further, a storage medium according to the present invention is an image processing apparatus having an image pickup means, at least a display means for displaying image information, an information processing apparatus for processing information,
A storage medium storing a control program for controlling an image processing system including the image processing device and a communication unit that performs communication between the information processing device, wherein the control program stores an image in the image processing device. A code for a step of transmitting information related to data to the information processing apparatus, and image information in a first state in which the information processing apparatus performs processing in accordance with the received information from the image processing apparatus. The code of the step of transmitting to the processing device, and the image information of the first state received by the image processing device,
And displaying the image information in the second state together with the image information captured by the image capturing means, and transmitting the image information in the second state to the information processing apparatus.

In the storage medium according to the present invention, the information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit. The second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the imaging unit, and the second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the display unit.

In the storage medium according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is the information on the imaging. It is characterized by information on the number of vertical and horizontal pixels of the means.

In the storage medium according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the image data displayed on the display means, and the information on the pixel configuration of the imaging means. The information is characterized in that it is information on the number of vertical and horizontal pixels of the image data imaged by the imaging means.

In the storage medium according to the present invention, the first state is a state corresponding to a data amount of an image to be displayed on the display means, and the second state is an image taken by the image pickup means. It is characterized in that it is in a state corresponding to the data amount of.

Further, the storage medium according to the present invention includes an image processing apparatus having an image pickup means and at least a display means for displaying image information, and capable of communicating with an information processing apparatus for processing information. A storage medium storing a control program for controlling, the control program according to a code of a step of transmitting information related to image data to the information processing apparatus, and information related to the transmitted image data. And a code for a step of receiving the image information in the first state processed by the information processing apparatus, and the received image information in the first state, together with the image information captured by the imaging unit, to the display unit. And displaying the image information in the second state and transmitting the image information to the information processing apparatus.

In the storage medium according to the present invention, the information transmitted from the image processing device is information relating to a pixel configuration of the display means and information relating to a pixel configuration of the imaging means. The second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the imaging unit, and the second state is a state of the pixel configuration corresponding to the information on the pixel configuration of the display unit.

In the storage medium according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the display means, and the information on the pixel configuration of the imaging means is the information on the image pickup. It is characterized by information on the number of vertical and horizontal pixels of the means.

In the storage medium according to the present invention, the information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of image data displayed on the display means, and the information on the pixel configuration of the imaging means is provided. The information is characterized in that it is information on the number of vertical and horizontal pixels of the image data imaged by the imaging means.

In the storage medium according to the present invention, the first state is a state corresponding to a data amount of an image displayed on the display means, and the second state is an image taken by the image pickup means. It is characterized in that it is in a state corresponding to the data amount of.

[0038]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram showing the overall system configuration of one embodiment of the present invention.

Reference numeral 100 denotes an image processing apparatus such as an electronic camera having a communication unit and an antenna 112.

Reference numeral 400 denotes an information processing apparatus having a communication means and an antenna 418, such as a computer normally used by a user.

Image processing apparatus 100 and information processing apparatus 400
Transmits and receives data including a predetermined command and an image to and from each other via a communication unit and an antenna.

<Description of Configuration of Image Processing Apparatus 100>
The configuration of the image processing apparatus 100 will be described with reference to FIG.

In FIG. 2, reference numeral 10 denotes a photographing lens, 12 denotes a shutter having an aperture function, 14 denotes an image pickup device that converts an optical image into an electric signal, and 16 denotes an A / A that converts an analog signal output of the image pickup device 14 into a digital signal. It is a D converter.

Reference numeral 18 denotes an image sensor 14, an A / D converter 16,
This is a timing generation circuit that supplies a clock signal and a control signal to the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22.

Further, in the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and based on the obtained arithmetic result, the system control circuit 50 sends the exposure control means 40 and the distance measurement control means 42 to the exposure control means 40 and the distance measurement control means 42. TT that controls
L (through the lens) type AF (auto focus) processing, AE (auto exposure) processing, and EF (flash pre-emission) processing are performed.

Further, in the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and TTL AWB (auto white balance) processing is also performed based on the obtained arithmetic result.

Reference numeral 22 denotes a memory control circuit, which includes an A / D converter 16, a timing generation circuit 18, an image processing circuit 20,
Image display memory 24, D / A converter 26, memory 30,
The compression / decompression circuit 32 is controlled.

The data of the A / D converter 16 is transmitted through the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is transmitted directly through the memory control circuit 22 to the image display memory 24 or the memory. 30 is written.

Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display section comprising a TFT / LCD, etc., and display image data written in the image display memory 24 is a D / A converter. The image is displayed by the image display unit 28 via the display 26.

If image data picked up by the image display unit 28 is sequentially displayed, an electronic finder function can be realized.

The image display unit 28 can arbitrarily turn on / off the display in accordance with an instruction from the system control circuit 50. When the display is turned off, the power consumption of the image processing apparatus 100 is greatly reduced. Can be reduced.

Reference numeral 30 denotes a memory for storing photographed still images and moving images, and has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time.

Thus, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images into the memory 30 at high speed.

The memory 30 is provided with a system control circuit 50.
Can also be used as a work area.

32 is an adaptive discrete cosine transform (ADCT)
A compression / decompression circuit for compressing / decompressing image data by, for example, reading an image stored in the memory 30 and performing compression or decompression processing, and storing the processed data in the memory 3
Write to 0.

An exposure control means 40 controls the shutter 12 having an aperture function, and also has a flash dimming function in cooperation with the flash 48.

Reference numeral 42 denotes distance measuring control means for controlling focusing of the photographing lens 10, reference numeral 44 denotes zoom control means for controlling zooming of the photographing lens 10, and reference numeral 46 denotes barrier control means for controlling the operation of the protection means 102 which is a barrier. .

Reference numeral 48 denotes a flash, which also has a function of projecting AF auxiliary light and a function of controlling flash light.

The exposure control means 40 and the distance measurement control means 42
The system control circuit 50 controls the exposure control means 40 and the distance measurement control means 42 on the basis of the calculation result obtained by calculating the captured image data by the image processing circuit 20.

Reference numeral 50 denotes a system control circuit for controlling the entire image processing apparatus 100, and reference numeral 52 denotes a memory for storing constants, variables, programs, and the like for operating the system control circuit 50.

Reference numeral 54 denotes a display unit such as a liquid crystal display device or a speaker for displaying an operating state or a message using characters, images, sounds, or the like in accordance with the execution of the program by the system control circuit 50. A single or a plurality of units are installed at easily visible positions near the 100 operation units, and are configured by a combination of, for example, LCDs, LEDs, sound generating elements, and the like.

The display unit 54 has a part of its functions installed in the optical viewfinder 104.

Among the display contents of the display unit 54, those to be displayed on the LCD or the like include, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining image capturing. Available number display, Shutter speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Battery remaining battery display, Battery remaining display, Error display, Multi-digit number Information display, display of detached state of recording media 200 and 210, communication I / F operation display, date
Time display, display indicating the connection status with the external computer,
Etc.

Among the display contents of the display unit 54, those displayed in the optical viewfinder 104 include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, and a shutter charging display. There are a speed display, an aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

Further, among the display contents of the display unit 54, L
The display on the ED or the like includes, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, a recording medium writing operation display, a macro shooting setting notification display, and a secondary battery charging state. display,
Etc.

Among the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp may be shared with the AF auxiliary light.

Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.

Reference numerals 60, 62, 64, 66, 68, 70 and 72 denote operation means for inputting various operation instructions of the system control circuit 50, such as switches and dials, a touch panel, pointing by gaze detection, and voice recognition. It is composed of a single device or a combination of a plurality of devices.

Here, these operation means will be specifically described.

Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as power-off, automatic photographing mode, photographing mode, panoramic photographing mode, reproducing mode, multi-screen reproducing / erasing mode, and PC connection mode.

Reference numeral 62 denotes a shutter switch SW1, which is turned on during the operation of a shutter button (not shown),
(Auto focus) processing, AE (auto exposure) processing, A
It instructs to start operations such as WB (auto white balance) processing and EF (flash pre-emission) processing.

Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of a shutter button (not shown) is completed, and transfers the signal read from the image sensor 14 to the memory 30 via the A / D converter 16 and the memory control circuit 22. Exposure processing for writing, development processing using arithmetic operations in the image processing circuit 20 and the memory control circuit 22, reading image data from the memory 30, performing compression in the compression / decompression circuit 32, and writing the image data in the recording medium 200 or 210 It instructs to start the operation of a series of processing called recording processing.

Reference numeral 66 denotes a selection / switch, which can set selection and switching of various functions when performing photographing and reproduction in a panorama mode or the like.

Reference numeral 68 denotes a decision / execution switch, which can determine and execute various functions when photographing and reproducing in a panorama mode or the like.

Reference numeral 70 denotes an operation unit including various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single-shot / continuous-shot / self-timer switching button,
Menu move + (plus) button, menu move-(minus) button, play image move + (plus) button, play image move-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, image Image display ON / OFF for setting ON / OFF of the display unit 28
Button, image data taken immediately after shooting
There is a quick review ON / OFF button for setting a quick review function for automatic playback at step 8.

Reference numeral 72 denotes a compression mode switch for selecting a compression rate of JPEG compression, or a CCDRA for digitizing a signal of an image pickup device as it is and recording it on a recording medium.
This is a switch for selecting the W mode.

As the JPEG compression mode, for example, a normal mode and a fine mode are prepared.

In the JPEG compression mode, the image data read from the image sensor 14 and written into the memory 30 via the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 is read. , Compression / decompression circuit 32
After performing compression to the compression ratio set by
Recording is performed at 0 or 210.

In the CCD RAW mode, image data is read out line by line according to the pixel arrangement of the color filter of the image sensor 14 and written to the memory 30 via the A / D converter 16 and the memory control circuit 22. The read image data is read and recorded on the recording medium 200 or 210.

Reference numeral 80 denotes a power supply control means, a battery detection circuit, D
It comprises a C-DC converter, a switch circuit for switching a block to be energized, and the like, and detects the presence or absence of a battery, the type of battery, the remaining battery level, and performs DC based on the detection result and an instruction from the system control circuit 50. Control the DC converter to supply a required voltage to each unit including the recording medium for a required period.

Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply means including a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.

Reference numerals 90 and 94 denote an interface with a recording medium such as a memory card or a hard disk, reference numerals 92 and 96 denote connectors for connecting to a recording medium such as a memory card or a hard disk, and reference numeral 98 denotes a connector 92 and / or 96 to the recording medium 200 or This is a recording medium attachment / detachment detecting unit that detects whether or not the recording medium 210 is attached. The recording medium attachment / detachment detecting means 98 connects the recording medium 2 to the connector 92 and / or 96.
It is also possible to detect whether or not, for example, various communication cards described below other than 00 or 210 are mounted.

In the present embodiment, the description has been made assuming that there are two interfaces and connectors for attaching the recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or plural number of systems. In addition, a configuration may be adopted in which interfaces and connectors of different standards are provided in combination. The interface and the connector may be configured using a standard such as a PCMCIA card or a CF (Compact Flash) card.

Further, the interfaces 90 and 94 and the connectors 92 and 96 are connected to a PCMCIA card or CF.
(Compact flash) When using a card conforming to the standard such as a card, a LAN card, a modem card, a USB card, an IEEE1394 card, a P128
By connecting various communication cards such as a 4-card, a SCSI card, a communication card such as a PHS, and the like, image data and management information attached to the image data are transferred to and from other peripheral devices such as a computer and a printer. I can do it.

Reference numeral 102 denotes the lens 1 of the image processing apparatus 100.
This is a protection unit that is a barrier that covers the imaging unit including “0” to prevent the imaging unit from being stained or damaged.

Reference numeral 104 denotes an optical finder, which allows photographing using only the optical finder without using the electronic finder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are provided.

Reference numeral 110 denotes communication means, such as RS232C or US
It has various communication functions such as B, IEEE1394, P1284, SCSI, modem, LAN, wireless communication, and the like.

Reference numeral 112 denotes a connector for connecting the image processing apparatus 100 to another device by the communication unit 110 or an antenna in the case of wireless communication.

Reference numeral 200 denotes a recording medium such as a memory card or a hard disk.

The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, and the image processing apparatus 1.
The image processing apparatus 100 includes an interface 204 for connecting to the image processing apparatus 100 and a connector 206 for connecting to the image processing apparatus 100.

Reference numeral 210 denotes a recording medium such as a memory card or a hard disk.

The recording medium 210 includes a recording section 212 composed of a semiconductor memory, a magnetic disk, or the like, and the image processing apparatus 1.
The image processing apparatus 100 includes an interface 214 for connecting to the image processing apparatus 100 and a connector 216 for connecting to the image processing apparatus 100. <Description of Configuration of Information Processing Apparatus 400> Next, the information processing apparatus 400 will be described with reference to FIG.

Reference numeral 402 denotes control means for controlling the entire information processing apparatus.

Reference numeral 404 denotes a CPU bus.
The first storage unit 406 is connected to the bus bridge 408 to transfer data processed by the control unit 402 at high speed.

Reference numeral 406 denotes a first storage unit which is a cache memory when the control unit 402 operates.
02 can be accessed at a high speed from
02 temporarily stores data used for the calculation. Generally, a high-speed SRAM or the like is used.

A bus bridge 408 connects the CPU bus 404 and a high-speed bus 412, which will be described later, and absorbs a difference in processing speed between the buses. Through the bus bridge 408, the control unit 402 that operates at a higher speed can transmit and receive data to and from each unit connected to the high-speed bus 412. The bus bridge 408 also has a memory controller function. The control unit 402 reads data temporarily written at high speed into the first storage unit 406 at a predetermined time, and reads the data from the second storage unit. It performs a series of memory management operations of writing data into the first storage unit 406 and writing data read from the second storage unit 410 in response to a request from the control unit 402.

Reference numeral 410 denotes a second storage unit, which is a control unit 40
Reference numeral 2 denotes a main memory for executing various applications. Generally, a DRAM or the like is used.

A high-speed bus 412 connects the bus bridge 404, the network unit 414, the communication unit 416, the display unit 420, and the bus bridge 422.
2 transfers the processed data to each unit, and transfers data between each unit at high speed (DMA transfer). Generally, a PCI bus is used.

Reference numeral 414 denotes a network unit for connecting the information processing apparatus 400 to a network, for transmitting and receiving data to and from the network. Generally, the network to be connected includes Ethernet, token ring, and the like.

Reference numeral 416 denotes a communication means such as a USB or IEEE 1
394, and has various communication functions such as SCSI, modem, LAN, wireless communication, and the like.

Reference numeral 418 denotes a connector for connecting the information processing apparatus 400 to another device by the communication means 416 or an antenna in the case of wireless communication.

Reference numeral 420 denotes a display unit constituted by a liquid crystal display device, a speaker, and the like, and displays necessary characters, images, sounds, and the like according to the execution of the program by the control unit 402.

A bus bridge 422 connects the high-speed bus 412 and a low-speed bus 424, which will be described later, and absorbs a difference in processing speed between the buses. Through this bus bridge 424, each unit operating at a high speed can exchange data with a unit operating at a low speed connected to the low speed bus 424.

A low-speed bus 424 connects the bus bridge 422, the third storage means 426, the operation means 428, and the computer interface 430.
This is a low-speed bus having a bus configuration with a lower transfer speed than that of No. 2, and is a bus for connecting units with relatively low processing capacity. Generally, an ISA bus or the like is used.

Reference numeral 426 denotes a third storage means for storing a plurality of applications for the operation of the control means 402, which is generally constituted by a large-capacity hard disk. The one below.

Reference numeral 428 denotes an operation means constituted by a keyboard, a microphone, etc., for inputting various settings necessary for the operation of the information processing apparatus 400 and for inputting various operation instructions to the control means 402.

Reference numeral 430 is a low-speed computer interface for connecting the information processing device 400 to peripheral devices. Generally, RS-232C for serial communication
And a Centronics interface for performing parallel communication, P1284, and the like.

The operation of the embodiment of the present invention will be described with reference to FIGS. 3 to 10 and FIGS.

FIG. 3 is a flowchart of a main routine of the image processing apparatus 100 according to the present embodiment.

The operation of the image processing apparatus 100 will be described with reference to FIG.

When the power is turned on such as when the battery is replaced, the system control circuit 50 initializes flags, control variables, and the like.
Initialization processing of each part of the image processing apparatus 100 is performed (S10
1).

The system control circuit 50 determines the setting position of the mode dial 60, and the mode dial 60
If it is set to FF (S102), the display of each display unit is changed to the end state, the barrier of the protection unit 102 is closed to protect the imaging unit, and necessary parameters and settings including flags and control variables are set. Non-volatile memory 56
After performing a predetermined end process such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power control unit 80 (S103), the process returns to S102.

If the mode dial 60 has been set to another mode (S102), the system control circuit 5
0, the power control means 80 determines whether the remaining capacity of the power supply 86 composed of a battery or the like or the operating condition has a problem in the operation of the image processing apparatus 100 (S104). After performing a predetermined warning display using an image or sound using the button 54 (S105), the process returns to S102.

If there is no problem with the power supply 86 (S10
4), proceed to S106.

If the mode dial 60 is set to the communication mode (S106), the system control circuit 50 executes a predetermined communication mode process (S107), and returns to S102 when the process is completed.

The details of this communication mode processing S107 are shown in FIG.
Will be described later.

If the mode dial 60 has been set to the photographing mode (S108), the system control circuit 50 executes a predetermined photographing mode process (S109), and after completing the process, returns to S102.

If the mode dial 60 has been set to the composite photographing mode (S108), the system control circuit 5
0 executes a predetermined composite photographing mode process (S110),
Upon completion of the process, the process returns to S102.

The details of the composite photographing mode process S110 will be described later with reference to FIGS.

If the mode dial 60 has been set to another mode (S108), the system control circuit 5
0 executes a process according to the selected mode (S11).
1) When the processing is completed, the process returns to S102.

FIG. 4 is a detailed flowchart of the communication mode process in S107 of FIG.

The system control circuit 50 includes a communication unit 110
Then, predetermined initialization processing relating to a communication function including a communication processing program is performed (S601).

The system control circuit 50 determines the set position of the mode dial 60, and if the mode dial 60 has been set to the communication mode (S602), the process proceeds to S605.

If the mode dial 60 has been set to another mode (S602), the system control circuit 5
0 terminates the connection with the communication line via the communication means 110 (S603), performs predetermined communication end processing related to the communication function including the communication means 110 and the communication processing program (S604), and then executes the communication mode processing S107. finish.

The system control circuit 50 includes the power control means 8
0, it is determined whether the remaining capacity of the power supply 86 composed of a battery or the like or the operating condition has a problem in the communication processing operation of the image processing apparatus 100 (S605), and if there is a problem, the display unit 54 is used. After a predetermined warning is displayed by an image or a sound (S608), the process returns to S602.

If there is no problem with the power supply 86 (S60)
5), the system control circuit 50 connects to the information processing device 400 via the communication means 110 and the communication line (S6).
06), if the connection is normal (S607), S609
Proceed to.

If there is a problem with the connection with the information processing apparatus 400 via the communication line (S607), the system control circuit 50 uses the display unit 54 to display a predetermined warning by image or sound (S608). ), And return to S602.

[0130] The system control circuit 50
If a command or the like is received from 00 via the communication line and the communication means 110 (S609), it is determined what command the received information contains (S609).
610).

As a result of determining the content of the received command,
If the command is a camera information request command (S610),
The system control circuit 50 transmits the camera information to the information processing device 400 via the communication unit 110 and the communication line (S611), and returns to S609 when the transmission is completed.

The camera information transmitted here includes the number of display pixels in the vertical direction, the number of display pixels in the horizontal direction, the total number of pixels, the number of display gradations for each color, the image display There are the number of vertical and horizontal pixels, the number of display gradations, and the like of the electronic finder image displayed in a part of the display area of the section 28.

The camera information transmitted here includes the number of pixels of the image sensor 14, the number of gradations, the color filter structure,
CCD-RAW format image data size, image compression ratio,
There are an image compression coefficient table, the size of image compression data, and the like.

As described above, by transmitting the camera information, particularly the information regarding the image display unit 28 to the information processing apparatus 400, the information processing apparatus 400 prepares the finder display data adapted to the image display unit 28 of the image processing apparatus 100. Then, the prepared finder display data can be transmitted to the image processing apparatus 100 and displayed on the image display unit 28 of the image processing apparatus 100.

As a result, communication of a small amount of image data corresponding to the number of pixels and the number of gradations of the image display unit 28, which are smaller than the number of pixels and the number of gradations of the image sensor 14, is performed. Communication costs can be reduced.

As a result of judging the content of the received command,
If the received command is another command (S610), the system control circuit 50 executes processing corresponding to the command (S610).
612), and return to S609.

As a result of determining the content of the received command,
If it is an image data reception command (S610),
The system control circuit 50 receives the image data via the communication line and the communication unit 110 and sequentially stores the image data in a predetermined area of the memory 30 (S613).

If the reception of the image data is completed (S6
14), the system control circuit 50 displays the received image data on the image display unit 28 from the attached information such as the identification number added to the image data, or the command or predetermined identification number information transmitted before and after the reception of the image data. (S615), and if it is determined that the image data is viewfinder display image data, a finder image flag is set (S616), and the finder image data identification number is stored (S617). , S609
Return to

The finder image flag and the identification number are stored in the internal memory of the system control circuit 50 or the memory 52.

If there is no photographed image data to be transmitted (S
618), if the communication with the information processing device 400 is terminated and the line connection is terminated (S619), or if the line connection is terminated after a predetermined time elapses (S6).
20), the system control circuit 50 terminates the connection with the information processing apparatus 400 via the communication means 110 and the communication line (S621), and returns to S602.

If there is captured image data to be transmitted (S618), the system control circuit 50 stores the image data in the internal memory of the system control circuit 50 or in the memory 52.
The correspondence information between the composite photographing finder image data used at the time of photographing and the photographed image data is read (S6).
22) Based on the read correspondence information, the image data photographed and stored in the predetermined area of the memory 30 is subjected to a trimming process for an area overlapping with the composite photographing finder image, and is stored again in the memory 30 ( S623).

After setting the predetermined transmission mode (S624), the system control circuit 50 sets
The transmission image data stored in the predetermined area is sequentially read (S625) and transmitted to the information processing apparatus 400 via the communication means 110 and the communication line (S626).

When the transmission of the composite photographed image data is completed (S627), the system control circuit 50
Of the captured image buffer area set in the predetermined area of
It is determined whether or not the transmitted image data area is cleared and released (S628). If the transmitted image data area is used for the next photographing, the buffer is cleared (S629), and the process returns to S609.

In this case, the transmitted synthesized image data is deleted, and no new image data is communicated.

If the buffer is not cleared (S62)
8) The process returns to S609.

In this case, the transmitted combined photographed image data can be transmitted again to the information processing device 400 and / or another receiving device.

FIGS. 5 and 6 are detailed flowcharts of the composite photographing mode process in S110 of FIG.

The system control circuit 50 performs a predetermined initialization process relating to the composite photographing mode function (S701).

The system control circuit 50 determines the set position of the mode dial 60, and if the mode dial 60 has been set to the composite photographing mode (S702), the process proceeds to S70.
Proceed to 4.

If the mode dial 60 has been set to another mode (S702), the system control circuit 5
In the case of 0, after performing a predetermined end process related to the composite shooting mode function (S703), the composite shooting mode process S110 ends.

If the synthesized finder image data is not transmitted from the information processing device 400 and stored in a predetermined area of the memory 30 (S704), the system control circuit 50 uses the display unit 54 to display an image or sound. Is displayed (S705), and the process returns to S702.

If one or more finder image data for composite photography transmitted from the information processing apparatus 400 is stored in a predetermined area of the memory 30 (S70)
4), the system control circuit 50 displays a finder image selection screen for composite photography on the image display unit 28.

The user of the image processing apparatus 100 can select a composite photographing finder image while viewing the composite photographing finder image selection screen displayed on the image display unit 28.

If the selection of the viewfinder image for composite photography has already been completed (S706), the flow advances to S710.

The system control circuit 50 reads out the composite photographing finder image data from a predetermined area of the memory 30, and, through the memory control circuit 22, reads out the image display memory 24.
Then, the image data transferred to the image display memory 24 is displayed on the image display unit 28 through the memory control circuit 22 and the D / A converter 26, and the selected finder image for composite photographing is displayed (S707). ).

If the user of the image processing apparatus 100 has set the display of a composite photographing finder image other than the displayed composite photographing finder image (S708), the system control circuit 50 Then, from the single or plural composite photographing finder image data stored in a predetermined area of the memory 30, the next composite photographing finder image is read out (S709) and displayed on the image display unit 28 (S707).

If the user of the image processing apparatus 100 selects and uses the displayed composite photographing finder image (S708, S710), the system control circuit 5
0 sets the display state of the image display unit 28 to the composite through display state (S711).

In the composite through display state, the data sequentially written to the image display memory 24 via the image pickup device 14, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 are transferred to the memory control circuit. Circuit 22, D / A converter 2
The electronic viewfinder function is realized by sequentially displaying the determined composite viewfinder image and the determined composite viewfinder image in the above-described photographing area of the image display unit 28 via the display unit 6.

If the shutter switch SW1 is released (S712), the flow returns to S702.

If the shutter switch SW1 has been pressed (S712), the flow advances to S731.

The system control circuit 50 controls the image display unit 28
Is set to the composite freeze display state (S73).
1) The process proceeds to S731.

In the composite freeze display state, rewriting of image data in the image display memory 24 via the image pickup device 14, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 is prohibited, and is finally written. Image data
The frozen image is displayed on the electronic viewfinder by displaying the image in the above-described shooting area of the image display unit 28 via the memory control circuit 22 and the D / A converter 26.

The system control circuit 50 performs a distance measuring process to focus the photographing lens 10 on the subject, and performs a photometric process to determine an aperture value and a shutter time (S73).
2). In the photometry processing, the flash setting is also performed if necessary.

The details of the distance measurement / photometry processing S732 are shown in FIG.
Will be described later.

After the distance measurement / photometry processing S732 is completed,
The system control circuit 50 sets the display state of the image display unit 28 to the composite through display state (S733), and proceeds to S734. Note that the combined through display state in S733 is the same as that in S7.
This is the same operation state as the synthesis through state in No. 11.

If the shutter switch SW2 is not pressed (S734) and the shutter switch SW1 is also released (S735), the flow returns to S702.

If the shutter switch SW2 is pressed (S734), the system control circuit 50 causes the image display unit 2
8 is set to the composite fixed color display state (S73).
8) The process proceeds to S739.

In the composite fixed color display state, instead of the photographed image data written to the image display memory 24 via the image pickup device 14, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22, The image data of the replaced fixed color is displayed on the image display unit 2 together with the composite photographing finder image via the memory control circuit 22 and the D / A converter 26.
By displaying the image in the above-mentioned photographing area of No. 8, a fixed color composite image is displayed on the electronic finder.

The system control circuit 50 includes the image pickup device 14,
Exposure processing for writing captured image data to the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22, and Using the memory control circuit 22 and, if necessary, the image processing circuit 20, the image data written in the memory 30 is read out, and a photographing process including a developing process for performing various processes is executed (S739).

The details of the photographing process S739 will be described later with reference to FIG.

The system control circuit 50 executes the photographing process S73
9 reads out the image data written in the memory 30, and outputs the image data to the image display memory 2 via the memory control circuit 22.
4 is executed (S740).

The details of the display image processing S740 will be described later with reference to FIG.

The system control circuit 50 controls the image display unit 28
Is set to the composite quick review display state (S741), and the flow proceeds to S742.

In the composite quick review state, the image data transferred to the image display memory 24 by the display image processing S180 is transmitted via the memory control circuit 22 and the D / A converter 26 together with the composite photographing finder image. ,
An electronic viewfinder function for automatically reproducing a composite photographed image is realized by displaying the image in the photographing area of the image display unit 28 described above.

The system control circuit 50 reads the photographed image data written in the memory 30 and performs various image processing using the memory control circuit 22 and the image processing circuit 20 as necessary. After performing compression processing for performing image compression processing in accordance with the mode set by using (S742), the recording medium 200 or 210 such as a memory card or a compact flash card is transmitted via the interface 90 or 94 and the connector 92 or 96.
A recording process of writing image data to the
743).

The details of this compression processing S743 will be described later with reference to FIG.

When the image display unit 28 is ON, while the image data is being written to the recording medium 200 or 210, a display such as "BUSY" indicating that the writing operation is being performed is displayed. This is performed on the display unit 28.

Further, in the display unit 54, for example, an LED
The display of the recording medium writing operation such as blinking is also performed.

The system control circuit 50 sets the composite photographing flag (S744) and stores the correspondence information of the composite image (S745).

The information on the correspondence between the composite photographing flag and the composite image is stored in the internal memory of the system control circuit 50 or the memory 52.

If the shutter switch SW1 has not been pressed (S746), the flow returns to S702.

If the shutter switch SW1 has been pressed (S746), the flow returns to S731.

FIG. 7 is a detailed flowchart of the distance measuring / photometric processing in S732 of FIG.

The system control circuit 50 reads out the charge signal from the image sensor 14 and sequentially reads the photographed image data into the image processing circuit 20 via the A / D converter 16 (S20).
1). Using the sequentially read image data, the image processing circuit 20 uses the TTL (through-the-lens) method A
Predetermined calculations used for E (auto exposure) processing, EF (flash pre-emission) processing, and AF (auto focus) processing are performed.

In each of the processes, a necessary portion of the total number of photographed pixels is extracted by cutting out necessary portions and used for calculation. Thus, in each of the TTL-based AE, EF, AWB, and AF processes, it is possible to perform an optimal calculation for each of the different modes such as the center-weighted mode, the average mode, and the evaluation mode.

Using the operation result in the image processing circuit 20,
The system control circuit 50 performs AE control using the exposure control means 40 (S203) until the exposure (AE) is determined to be appropriate (S202).

[0187] Using the measurement data obtained by the AE control,
The system control circuit 50 determines whether or not a flash is necessary (S204), and if necessary, sets a flash flag and charges the flash 48 (S20).
5).

If it is determined that the exposure (AE) is appropriate (S
202), storing the measurement data and / or setting parameters in the internal memory of the system control circuit 50 or the memory 52;

The system control circuit 5 uses the calculation results of the image processing circuit 20 and the measurement data obtained by the AE control.
0 indicates that the AWB control is performed by adjusting the color processing parameters using the image processing circuit 20 until the white balance (AWB) is determined to be appropriate (S206) (S207).

When it is determined that the white balance (AWB) is appropriate (S206), the measurement data and / or the setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52.

Using the measurement data obtained by the AE control and the AWB control, the system control circuit 50 executes the distance measurement control means 42 until the distance measurement (AF) is determined to be in focus (S208).
Is used to perform AF control (S209).

If it is determined that the distance measurement (AF) is in focus (S
208), the measurement data and / or the setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50, and the distance measurement / photometry processing routine S732 ends.

FIG. 8 is a detailed flowchart of the photographing process in S739 of FIG.

The system control circuit 50 opens the shutter 12 having the aperture function according to the aperture value by the exposure control means 40 in accordance with the photometric data stored in the internal memory of the system control circuit 50 or the memory 52. 10 is exposed (S301, S302).

Flash 48 by flash flag
Is determined (S303), and if necessary, a flash is emitted (S304).

The system control circuit 50 waits for the end of exposure of the image sensor 12 in accordance with the photometric data (S305), closes the shutter 12 (S306), reads a charge signal from the image sensor 14, reads the charge signal from the A / D converter 16, Processing circuit 2
0, the memory 30 via the memory control circuit 22 or directly from the A / D converter 16 via the memory control circuit 22.
Then, the data of the photographed image is written in (S307).

When a series of processing is completed, the photographing processing routine S739 ends.

FIG. 9 is a detailed flowchart of the display image processing in S740 of FIG.

If frame processing needs to be performed in accordance with the set photographing mode (S401), the system control circuit 50 uses the memory control circuit 22 and, if necessary, the image processing circuit 20 to store the data in the memory 30. Is read out, and vertical addition processing (S402) is performed.
After the color processing (S403) is sequentially performed, the processed image data is written in the memory 30.

The system control circuit 50 reads out the image data from the memory 30, and transfers the display image data to the image display memory 24 via the memory control circuit 22 (S4).
04).

When a series of processing is completed, the display image processing routine S740 is completed.

FIG. 10 is a detailed flowchart of the compression processing in S742 of FIG.

The system control circuit 50 reads out the photographed image data written in the memory 30 by using the memory control circuit 22 and, if necessary, the image processing circuit 20, and interpolates the vertical / horizontal pixel ratio of the image sensor to 1: 1. After performing the pixel square processing (S501), the processed image data is written to the memory 30.

Then, the image data written in the memory 30 is read, and the image compression processing corresponding to the set mode is performed by the compression / decompression circuit 32 (S502).

When the image compression processing is completed, the compression processing routine S742 ends.

FIG. 12 shows an information processing apparatus 400 according to this embodiment.
5 is a flowchart of a main routine of FIG.

The operation of the information processing device 400 will be described with reference to FIG.

When the power of the information processing apparatus 400 is turned on, the control means 402 initializes flags, registers, control variables, and the like, and executes a control program such as an operating system stored in a part of the area of the second storage means 410. The data is once read into the first storage unit 406 by a predetermined amount via the bus bridge 408 having a memory controller function, and then executed. Then, the control unit 402 initializes each unit of the information processing device 400 (S801).

The control means 402 determines that the input from the keys, the touch panel, the digitizer, etc. of the operation means 428 is not a command input for executing the communication mode but a command input for executing other processing. If (S802), various processes corresponding to the input command are executed (S803), and the process returns to S802 after executing the various processes.

If the input by the keys, the touch panel, the digitizer, etc. of the operation means 428 is a command input for executing the communication mode (S802), the control means 402 transmits the communication data including the communication means 416 and the communication processing program. The function is initialized (S804).

If there is an input to the operation means 428 to end the communication mode (S805), the control means 402
Disconnects the connection with the communication line via the communication means 416 (S806), performs predetermined communication end processing related to the communication function including the communication means 416 and the communication processing program (S807), and returns to S802.

The control means 402 makes a connection with the image processing apparatus 100 via the communication means 416 and the communication line (S
808), if the connection is normally established (S809), S81
Proceed to 1.

If there is a problem in connection with the image processing apparatus 100 via the communication line (S809), the control unit 402
Performs a predetermined warning display using an image or a sound using the display unit 420 (S810), and returns to S805.

If a command or data is received from the image processing apparatus 100 via the communication line and the communication means 416 (S811), the control means 402 executes the reception processing (S812), and after the reception processing is completed. It returns to S811.

[0215] Details of the receiving process S812 will be described later with reference to FIG.

If the image processing apparatus 100 is requested to transmit camera information (S813), the control unit 402
After transmitting the camera information request command (S81
4) Return to S811.

If the finder image data for composite photographing is transmitted to the image processing apparatus 100 (S81)
5), the control unit 402 executes a transmission process (S81).
6) After returning to the transmission process, the process returns to S811.

Details of this transmission processing S811 will be described later with reference to FIG.

If there is no composite finder image data to be transmitted (S815), and if the communication with the image processing apparatus 100 is terminated and the line connection is terminated (S817),
Alternatively, if the line connection is terminated after a predetermined time elapses (S818), the control unit 402 terminates the connection with the image processing apparatus 100 via the communication unit 416 and the communication line (S819), and proceeds to S805. Return.

FIG. 13 is a detailed flowchart of the receiving process in S812 of FIG.

If the data received from the image processing apparatus 100 via the communication line and the communication means 416 is camera information (S901), the control means 402 sets the received camera information (S902), The routine S812 ends.

The camera information received here includes the number of display pixels in the vertical direction, the number of display pixels in the horizontal direction, the total number of pixels, and the display gradation for each color of the image display unit 28 composed of a color TFT LCD or the like of the image processing apparatus 100. The number, the number of vertical and horizontal pixels of the electronic finder image displayed in a part of the display area of the image display unit 28, the number of display gradations, and the like.

The camera information received here includes the number of pixels, the number of gradations, the color filter structure, the size of CCD-RAW format image data, the image compression ratio, and the image compression coefficient of the image sensor 14 of the image processing apparatus 100. There are tables, sizes of compressed image data, and the like.

As described above, by receiving camera information from the image processing apparatus 100, particularly information relating to the image display section 28, finder display data adapted to the image display section 28 of the image processing apparatus 100 is prepared and prepared. The finder display data can be transmitted to the image processing apparatus 100 and displayed on the image display unit 28 of the image processing apparatus 100.

Thus, communication with a small amount of image data corresponding to the number of pixels and the number of gradations of the image display unit 28, which is a value smaller than the number of pixels and the number of gradations of the image sensor 14, is performed. Communication costs can be reduced.

If the data received from the image processing apparatus 100 via the communication line and the communication means 416 is not camera information or photographed image data (S903), the control means 402 executes processing corresponding to the received data. After the execution (S904), the reception processing routine S812 ends.

If the data received from the image processing apparatus 100 via the communication line and the communication means 416 is photographed image data (S903), the control means 402 continues until the reception of the photographed image data is completed (S906). ), The process of receiving the captured image data via the communication line and the communication unit 416 and storing the received captured image data in the third storage unit 426 is repeated (S905).

When the reception of the photographed image data is completed (S
906), the control unit 402 receives the correspondence information between the photographed image data and the composite photographing finder image data used at the time of photographing with the image processing apparatus 100, and receives the first storage unit 406 or the second storage unit 406. It is stored in the storage means 410 (S907).

The control means 402 reads out the finder image data before resizing from the third storage means 426 (S908), and reads out the received photographed image data from the third storage means 426 to perform the composite image processing (S9).
09), displaying the image data subjected to the composite image processing on the display unit 4
20 for display (S910).

If recording of a composite image is not performed (S91)
1) The reception processing routine S812 ends as it is.

If recording of a composite image is to be performed (S91)
1) The control unit 402 records the combined result in the third storage unit 426 (S912), and executes the reception processing routine S
End 812.

FIG. 14 is a detailed flowchart of the transmission process in S816 in FIG.

The control means 402 reads out the transmission image data from the third storage means 426 and selects the transmission image selection screen on the display means 420 in order to select the composite photographing finder image data to be transmitted to the image processing apparatus 100. Is displayed together with (S1001).

If the user of the information processing apparatus 400 sets display of a transmission image other than the displayed transmission image (S1).
003), the control unit 402 reads out the next transmission image data from the transmission image data for one or a plurality of composite photographing viewfinders stored in the third storage unit 426 (S1003), and displays the display unit 420. (S
100 l).

If the user of information processing apparatus 400 selects the displayed transmission image and decides to use it (S100
2, S1004), and the control unit 402
It is determined whether the camera information has been received from 00 (S1005).

If the camera information has not been received from the image processing apparatus 100 (S1005), the control means 402
After performing a predetermined warning display using an image or a sound using the display unit 420 (S1006), the transmission processing routine S816 ends.

If the camera information has been received from the image processing apparatus 100 (S1005), the control means 402
The finder image data for composite photography to be transmitted is resized according to the received camera information (S1007).

The received camera information includes the number of display pixels in the vertical direction, the number of display pixels in the horizontal direction, the total number of pixels, and the number of display gradations for each color of the image display unit 28 composed of a color TFT LCD or the like of the image processing apparatus 100. The number of vertical and horizontal pixels of the electronic finder image displayed in a part of the display area of the image display unit 28,
There is a display gradation number, and the like.

[0239] The received camera information includes
The number of pixels of the image sensor 14 of the image processing apparatus 100, the number of gradations,
There are a color filter structure, CCD-RAW format image data size, image compression ratio, image compression coefficient table, image compressed data size, and the like.

As described above, the camera information, particularly the information related to the image display unit 28, is received from the image processing apparatus 100, and the finder display data adapted to the image display unit 28 of the image processing apparatus 100 is prepared. The data can be transmitted to the image processing apparatus 100 and displayed on the image display unit 28 of the image processing apparatus 100.

Thus, in the image processing apparatus 100, communication of a small amount of image data corresponding to the number of pixels of the image display unit 28 and the number of gradations, which are smaller than the number of pixels and the number of gradations of the image pickup device 14, This can be performed on the image processing apparatus 100 to reduce communication time and communication cost.

The control unit 402 repeats the process of transmitting the composite photographing finder image data via the communication unit 416 and the communication line until the transmission of the composite photographing finder image data is completed (S1009) (S1009).
8).

When the transmission of the finder image data for composite photography is completed (S1009), the control means 402 ends the transmission processing routine S816.

FIG. 15 is an explanatory diagram showing the flow of commands and image data transmitted and received between the image processing apparatus 100 and the information processing apparatus 400 according to the embodiment of the present invention.

FIG. 15 is described with reference to FIGS.
2 to 14 are the same as those described with reference to FIG.

The embodiment of the present invention has been described with reference to FIG.

In the description of the embodiment, it has been described that communication of camera information, a finder image, and a composite photographed image is performed between the image processing apparatus 100 and the information processing apparatus 400. There is no problem if communication of camera information, a finder image, and a composite photographed image is performed between the camera and another image processing apparatus such as an electronic camera. In this case, similarly to the embodiment, the data amount of the image to be communicated can be reduced.

In the description of the embodiment, the finder image transmitted from the information processing device 400 is used to display the composite photographing finder on the image display unit 28 of the image processing device 100. The finder display for combined image shooting may be performed using the finder image.

Alternatively, using the transmitted finder image, a finder display for giving a photographing instruction or photographing reference may be performed.

Further, in the description of the embodiment, a series of processing is performed between the single image processing apparatus 100 and the single information processing apparatus 400. There is no problem with the system configuration.

The recording media 200 and 210 are PC
Not only memory cards such as MCIA cards and compact flashes, hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-R and CD-WR,
Of course, there is no problem even if it is constituted by a phase change optical disk such as a DVD.

There is no problem if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Further, there is no problem if a part of the composite medium is detachable.

In the description of the embodiment, the recording media 200 and 210 are separated from the image processing apparatus 100 and can be arbitrarily connected. Of course, there is no problem even if it is fixed to the device 100.

Further, the recording medium 20 is stored in the image processing apparatus 100.
0 or 210 may be configured to be connectable to a single or a plurality of arbitrary numbers.

Further, the recording medium 20 is stored in the image processing apparatus 100.
Although the configuration in which the recording media 0 and 210 are mounted has been described, it goes without saying that the recording medium may have any configuration of a single or a plurality of combinations.

In FIG. 2, the communication means 110 has been described as being directly connected to the system control circuit 50. However, the memory 30, the compression / decompression means 32, and the memory control means 2
2. There is no problem in connecting to a higher-speed bus together with the interface 90 and the interface 94.

Further, another object of the present invention is to supply a storage medium (or a recording medium) on which a program code of software for realizing the functions of the above-described embodiments is recorded to a system or an apparatus, and to provide the system or the apparatus. It is needless to say that the present invention can also be achieved by a computer (or CPU or MPU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. The functions of the above-described embodiments are not only realized by the computer executing the readout program code, but also the operating system running on the computer based on the instructions of the program code.
It goes without saying that the (OS) performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. Needless to say, the CPU included in the function expansion card or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts (shown in FIGS. 3 to 10 and FIGS. 12 to 14). become.

[0259]

As described above, according to the present invention,
Image communication between the computer and the electronic camera when creating an image combining the image transmitted from the computer and the image captured by the electronic camera, or when creating an image combining the image transmitted and the captured image. Can make it possible to solve the problem that the amount of image data to be communicated increases, the communication time increases, and / or the communication cost increases.

Also, the computer transmits one image data to be synthesized to the electronic camera, and the electronic camera displays the received image data together with the image before photographing on the electronic finder, and the photographed image data and the image data transmitted from the computer are transmitted. Since the synthesized image data was sent back to the computer after the image was synthesized, the amount of image data transmitted from the computer to the electronic camera and the amount of image data transmitted from the electronic camera to the computer were both images of the image sensor included in the electronic camera. It is possible to solve the problem that the data amount or the image data amount according to the imaging mode increases, the image data amount to be communicated increases, the communication time increases, and / or the communication cost increases.

[Brief description of the drawings]

FIG. 1 is an overall configuration block diagram of an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment.

FIG. 3 is a flowchart of a main routine of the image processing apparatus according to the embodiment;

FIG. 4 is a flowchart of a communication mode processing routine of the image processing apparatus according to the embodiment.

FIG. 5 is a flowchart of a composite photographing mode processing routine of the image processing apparatus according to the embodiment;

FIG. 6 is a flowchart of a composite photographing mode processing routine of the image processing apparatus according to the embodiment.

FIG. 7 is a flowchart of a distance measurement / photometry processing routine of the image processing apparatus according to the embodiment;

FIG. 8 is a flowchart of a shooting processing routine of the image processing apparatus according to the embodiment.

FIG. 9 is a flowchart of a display image processing routine of the image processing apparatus according to the embodiment.

FIG. 10 is a flowchart of a compression processing routine of the image processing apparatus according to the embodiment.

FIG. 11 is a configuration block diagram of an information processing apparatus according to an embodiment.

FIG. 12 is a flowchart of a main routine of the information processing apparatus according to one embodiment.

FIG. 13 is a flowchart of a reception processing routine of the information processing apparatus of one embodiment.

FIG. 14 is a flowchart of a transmission processing routine of the information processing apparatus according to the embodiment.

FIG. 15 is an explanatory diagram showing a flow of commands and image data transmitted and received between the image processing apparatus and the information processing apparatus according to the embodiment.

[Explanation of symbols]

 Reference Signs List 10 photographing lens 12 shutter 14 image sensor 16 A / D converter 18 timing generation circuit 20 image processing circuit 22 memory control circuit 24 image display memory 26 D / A converter 28 image display unit 30 memory 32 image compression / decompression circuit 40 exposure Control means 42 Distance measurement control means 44 Zoom control means 46 Barrier control means 48 Flash 50 System control circuit 52 Memory 54 Display unit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1 64 Shutter switch SW2 66 Select / switch switch 68 Decision / Execution switch 70 Operation section 72 Compression mode switch 80 Power control means 82 Connector 84 Connector 86 Power supply means 90 Interface 92 Connector 94 Interface 96 Connector 98 Recording medium attachment / detachment Detecting unit 100 Image processing device 102 Protecting unit 104 Optical finder 110 Communication unit 112 Connector (or antenna) 200 Recording medium 202 Recording unit 204 Interface 206 Connector 210 Recording medium 212 Recording unit 214 Interface 216 Connector 400 Information processing device 402 Control unit 404 CPU Bus 406 First storage unit 408 Bus bridge 410 Second storage unit 412 High-speed bus 414 Network unit 416 Communication unit 418 Connector (or antenna) 420 Display unit 422 Bus bridge 424 Low-speed bus 426 Third storage unit 428 Operating unit 430 Computer I / F

Claims (30)

[Claims] 1. An image processing apparatus having an imaging unit and a display unit for displaying at least image information, an information processing apparatus for processing information, and a communication for communicating between the image processing apparatus and the information processing apparatus. And an image processing system comprising: means for transmitting information related to image data to the information processing apparatus, wherein the information processing apparatus performs processing in accordance with the received information from the image processing apparatus. Transmitting the performed image information of the first state to the image processing apparatus, wherein the image processing apparatus displays the received image information of the first state on the display unit together with the image information captured by the imaging unit. An image processing system for capturing image information in a second state and transmitting the image information to the information processing apparatus. 2. The information transmitted from the image processing apparatus is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. 2. The image processing system according to claim 1, wherein the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. 3. 3. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 3. The information of claim 2,
An image processing system according to claim 1. 4. The information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the image data displayed on the display means, and the information on the pixel configuration of the imaging means is an image captured by the imaging means. 3. The image processing system according to claim 2, wherein the information is information on the number of pixels in the vertical and horizontal directions of the obtained image data. 5. The first state is a state corresponding to the data amount of an image displayed on the display means, and the second state is a state corresponding to the data amount of an image picked up by the image pickup means. The image processing system according to claim 1, wherein: 6. An image processing apparatus comprising: an image pickup unit; and a display unit for displaying at least image information, and capable of communicating with an information processing apparatus for processing information. Transmitting information to the information processing apparatus, receiving image information in a first state processed by the information processing apparatus in accordance with information related to the transmitted image data, and An image processing apparatus, wherein image information is displayed on the display unit together with image information captured by the imaging unit, and image information in a second state is captured and transmitted to the information processing apparatus. 7. The information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. 7. The image processing apparatus according to claim 6, wherein the state is a corresponding pixel configuration, and the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. 8. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 8. The information of claim 7,
An image processing apparatus according to claim 1. 9. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of image data displayed on the display unit, and the information on the pixel configuration of the imaging unit is obtained by the imaging unit. 8. The image processing apparatus according to claim 7, wherein the information is information on the number of vertical and horizontal pixels of the image data. 10. The first state is a state corresponding to a data amount of an image displayed on the display means, and the second state is a state corresponding to the second state.
7. The image processing apparatus according to claim 6, wherein the state corresponds to a data amount of an image captured by the imaging unit. 11. An image processing apparatus having an image pickup means, at least a display means for displaying image information, an information processing apparatus for processing information, and a communication for performing communication between the image processing apparatus and the information processing apparatus. And a control method of the image processing system for controlling the image processing system comprising: means for causing the image processing apparatus to transmit information related to image data to the information processing apparatus; Causing the image processing device to transmit the first state image information that has been processed in accordance with the information from the image processing device, An image processing system for displaying the image information in the second state together with the image information captured by the image capturing means, and transmitting the image information in the second state to the information processing apparatus. Control method. 12. The information transmitted from the image processing apparatus is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. The control of the image processing system according to claim 11, wherein the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. Method. 13. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 13. The control method for an image processing system according to claim 12, wherein the information is information of the image processing system. 14. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of image data displayed on the display unit, and the information on the pixel configuration of the imaging unit is obtained by the imaging unit. 13. The control method according to claim 12, wherein the information is information on the number of vertical and horizontal pixels of the image data. 15. The first state is a state corresponding to the data amount of an image displayed on the display means, and the second state is a state corresponding to the second state.
12. The method according to claim 11, wherein the state corresponds to a data amount of an image captured by the imaging unit. 16. An image processing apparatus for controlling an image processing apparatus having an imaging unit and a display unit for displaying at least image information and capable of communicating with an information processing apparatus for processing information. A control method, wherein information related to image data is transmitted to the information processing apparatus, and the image information in the first state processed by the information processing apparatus according to the transmitted information related to the image data is displayed. And causing the display unit to display the received image information in the first state together with the image information captured by the imaging unit, and capturing the image information in the second state and transmitting the image information to the information processing apparatus. A method for controlling an image processing apparatus, comprising: 17. The information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. 17. The method according to claim 16, wherein the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. . 18. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 18. The method according to claim 17, wherein the information is information of the image processing apparatus. 19. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of image data displayed on the display unit, and the information on the pixel configuration of the imaging unit is obtained by the imaging unit. 18. The method according to claim 17, wherein the information is information on the number of pixels in the vertical and horizontal directions of the image data. 20. The first state is a state corresponding to the data amount of an image displayed on the display means, and the second state is a state corresponding to the second state.
17. The method according to claim 16, wherein the state corresponds to a data amount of an image captured by the imaging unit. 21. An image processing apparatus having an imaging unit and at least a display unit for displaying image information, an information processing apparatus for processing information, and a communication for communicating between the image processing apparatus and the information processing apparatus. And a storage medium storing a control program for controlling an image processing system comprising: means for causing the image processing apparatus to transmit information related to image data to the information processing apparatus. A code for causing the information processing apparatus to transmit, to the image processing apparatus, image information in a first state that has been processed in accordance with the received information from the image processing apparatus; and Displaying the received image information in the first state together with the image information captured by the image capturing means on the display means, and capturing the image information in the second state. Storage medium characterized by having a code step of transmitting to the information processing apparatus Te. 22. Information transmitted from the image processing apparatus is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. 22. The storage medium according to claim 21, wherein the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. 23. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 23. The storage medium according to claim 22, wherein the information is information of the following. 24. The information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the image data displayed on the display means, and the information on the pixel configuration of the imaging means is an image captured by the imaging means. 23. The storage medium according to claim 22, wherein the information is information on the number of vertical and horizontal pixels of the obtained image data. 25. The first state is a state corresponding to the data amount of an image displayed on the display means, and
22. The storage medium according to claim 21, wherein the state is a state corresponding to a data amount of an image captured by the imaging unit. 26. A control program for controlling an image processing apparatus having an image pickup means and at least a display means for displaying image information and capable of communicating with an information processing apparatus for processing information. The control program, wherein the control program causes the information processing apparatus to transmit information related to image data to the information processing apparatus, and the information processing apparatus performs processing in accordance with the transmitted information related to the image data. A code of a step of receiving the performed image information in the first state and the received image information in the first state are displayed on the display unit together with the image information captured by the imaging unit, and the second state is displayed. And a code for causing the information processing apparatus to capture the image information and transmit the image information to the information processing apparatus. 27. Information transmitted from the image processing device is information on a pixel configuration of the display unit and information on a pixel configuration of the imaging unit, and the first state is information on a pixel configuration of the display unit. 17. The storage medium according to claim 16, wherein the storage medium is a state of a corresponding pixel configuration, and the second state is a state of a pixel configuration corresponding to information on a pixel configuration of the imaging unit. 28. The information on the pixel configuration of the display unit is information on the number of vertical and horizontal pixels of the display unit, and the information on the pixel configuration of the imaging unit is the number of vertical and horizontal pixels on the imaging unit. 18. The storage medium according to claim 17, wherein the storage medium is information of the following. 29. The information on the pixel configuration of the display means is information on the number of vertical and horizontal pixels of the image data displayed on the display means, and the information on the pixel configuration of the imaging means is an image captured by the imaging means. 18. The storage medium according to claim 17, wherein the information is information on the number of vertical and horizontal pixels of the image data obtained. 30. The first state is a state corresponding to a data amount of an image displayed on the display means, and the second state is a state corresponding to the second state.
17. The storage medium according to claim 16, wherein the state corresponds to a state corresponding to a data amount of an image captured by the imaging unit.