WO2020049958A1 - 情報処理システム、情報処理方法、端末装置および情報処理装置 - Google Patents
情報処理システム、情報処理方法、端末装置および情報処理装置 Download PDFInfo
- Publication number
- WO2020049958A1 WO2020049958A1 PCT/JP2019/031661 JP2019031661W WO2020049958A1 WO 2020049958 A1 WO2020049958 A1 WO 2020049958A1 JP 2019031661 W JP2019031661 W JP 2019031661W WO 2020049958 A1 WO2020049958 A1 WO 2020049958A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- specific object
- unit
- terminal device
- communication unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6209—Protecting access to data via a platform, e.g. using keys or access control rules to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/82—Protecting input, output or interconnection devices
- G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/913—Television signal processing therefor for scrambling ; for copy protection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/913—Television signal processing therefor for scrambling ; for copy protection
- H04N2005/91357—Television signal processing therefor for scrambling ; for copy protection by modifying the video signal
Definitions
- the present disclosure relates to an information processing system, an information processing method, a terminal device, and an information processing device.
- SNS Social Networking Service
- the present disclosure has an object to provide an information processing system, an information processing method, a terminal device, and an information processing device capable of both viewing an original image before processing and viewing an image after processing.
- an information processing system includes an image sensor that converts received light into an image, an image processing unit that detects a specific object in the image, and an output interface that outputs an image.
- the processor receives the image transmitted from the terminal device by the second communication unit, and when the image received by the second communication unit is an image in which the specific object is detected by the image processing unit. Then, a mask process for masking a specific object is performed.
- FIG. 1 is a diagram schematically illustrating a configuration of an example of an information processing system applicable to each embodiment.
- FIG. 2 is a diagram schematically illustrating a flow of processing by the information processing system according to the first embodiment.
- FIG. 3 is a block diagram illustrating an example of a hardware configuration of a server applicable to the first embodiment.
- FIG. 2 is a block diagram illustrating an example of a hardware configuration of a terminal device applicable to the first embodiment.
- FIG. 3 is a block diagram illustrating an example of a hardware configuration of an imaging unit applicable to the first embodiment.
- FIG. 3 is a diagram illustrating an example in which the imaging unit according to the first embodiment is formed by a stacked CIS having a two-layer structure.
- FIG. 3 is a diagram illustrating an example in which the imaging unit according to the first embodiment is formed by a three-layer stacked CIS.
- FIG. 3 is an example functional block diagram for explaining functions of the terminal device according to the first embodiment.
- FIG. 4 is a diagram schematically illustrating a state where a specific object is detected from a captured image, which is applicable to the first embodiment.
- FIG. 4 is a diagram schematically illustrating a state where a specific object is detected from a captured image, which is applicable to the first embodiment.
- FIG. 5 is a flowchart illustrating an example of a process performed by the server according to the first embodiment.
- FIG. 5 is a diagram illustrating an example in which mask processing is performed on each rectangular area included in a captured image according to the first embodiment.
- FIG. 5 is a diagram illustrating an example in which mask processing is performed on each rectangular area included in a captured image according to the first embodiment.
- FIG. 4 is a diagram schematically illustrating an example of a method of encrypting a rectangular area in an image compressed and encoded by the JPEG method, which is applicable to the first embodiment.
- 5 is an example sequence chart illustrating an overall operation of the information processing system according to the first embodiment.
- 13 is a flowchart illustrating an example of a process performed by a server according to the second embodiment.
- 13 is an example sequence chart illustrating an overall operation of the information processing system according to the second embodiment.
- FIG. 13 is a diagram illustrating an example of a configuration of an information processing system according to a third embodiment.
- FIG. 1 is a diagram schematically illustrating a configuration of an example of an information processing system applicable to each embodiment.
- the information processing system 1 includes a server 10 and a terminal device 30 connected by a network 2 such as the Internet as a hardware configuration.
- the server 10 is configured in a distributed manner by, for example, a plurality of information processing devices and storage devices on the cloud network 3.
- the present invention is not limited thereto, and the server 10 may be configured by one information processing device including, for example, a storage device.
- the terminal device 30 is, for example, a mobile terminal such as a smartphone or a tablet computer, and includes an imaging function.
- the user 31 can transmit a captured image captured using the imaging function of the terminal device 30 to the network 2.
- the information processing system 1 may further include terminal devices 40 and 41 connectable to the network 2.
- the terminal device 40 is shown as a mobile terminal
- the terminal device 41 is shown as a desktop personal computer (PC).
- the server 10 provides a closed service, for example, SNS (Social Networking Service) to a person who has registered an account.
- SNS Social Networking Service
- the terminal devices 30, 40, and 41 are equipped with specific application software, and use the application software to register an account with the server 10, whereby the service can be used.
- the application software is used by being mounted on each of the terminal devices 30, 40 and 41.
- the application software is not limited to this, and may be operated on the server 10.
- the service can be used by accessing the server 10 from a browser application installed in each of the terminal devices 30, 40, and 41.
- description will be made assuming that the application software is installed in the terminal devices 30 and 40.
- the service provided by the server 10 is an SNS, and application software for using the service is referred to as an SNS application.
- the user 31 of the terminal device 30 sets account information including identification information (for example, a user name and a password) for identifying the user 31 using an SNS application mounted on the terminal device 30, and transmits the set account information to the server. 10 to register an account.
- the server 10 authenticates the user 31 based on the account information transmitted from the terminal device 30, and when the authentication is successful, permits the user 31 to log in to the SNS.
- the user 31 can transmit a captured image captured using the imaging function of the terminal device 30 to the server 10 via the network 2, for example. it can.
- the server 10 can store the captured image transmitted from the terminal device 30 and publish the captured image via SNS.
- the terminal device 40 it is assumed that the user (not shown) of the terminal device 40 has registered account information in the server 10 using the SNS application.
- FIG. 2 is a diagram schematically illustrating a flow of processing by the information processing system 1 according to the first embodiment.
- the user 31 accesses the server 10 using the SNS application in the terminal device 30 and logs in to the SNS. After logging in to the SNS, the user 31 captures an image of a subject using the imaging function of the terminal device 30 (step S1).
- the SNS application analyzes the captured image and detects a specific object included in the captured image (Step S2).
- the specific object to be detected by the terminal device 30 refers to an image indicating personal information itself or an image that may include personal information among images included in the captured image. More specifically, the face image is an image showing the personal information itself. The image of the license plate of the vehicle is also considered to be an image showing the personal information itself. Also, the image of the open window of the building may contain personal information.
- the SNS application when a specific object is detected from a captured image, the SNS application adds identification information (referred to as a detection flag) indicating the detection to the captured image.
- the terminal device 30 transmits the captured image to the server 10 via the network 2 using the SNS application (Step S3).
- the server 10 analyzes the captured image and determines a specific object included in the captured image. To detect. Then, the server 10 performs a reversible mask process on the detected specific object (Step S4). Due to the mask processing, the captured image is in a state where the original image of the specific object portion cannot be determined.
- the server 10 stores the captured image subjected to the mask processing (referred to as a mask processed image) in a storage device such as a hard disk drive, and registers the image in the SNS.
- a user who has registered an account in the SNS obtains a mask processing image registered in the SNS using the terminal device 40 on which the SNS application is installed.
- the user accesses the server 10 using the SNS application in the terminal device 40, logs in to the SNS, and requests the server 10 for the masked image (step S10).
- the request for the mask processing image by the terminal device 40 is based on the legitimate access performed by logging in to the SNS.
- the request for the mask processing image may be regarded as a request for the mask processing image by the user logging in to the SNS from the terminal device 30, or a display screen by the SNS application during operation of the SNS application.
- the switching of the page may be regarded as a request for the mask processing image.
- scrolling the page of the display screen by the SNS application, or enlarging or reducing the display on the display screen may be regarded as the request for the mask processing image.
- the request for the masked image means that the user Includes processing to operate the SNS application without being aware of its existence.
- the server 10 performs a release process of releasing the mask applied to the masked image in response to the request for the masked image by the authorized access (step S11). Thereby, the terminal device 40 can acquire an image (referred to as an image without a mask) in which the mask of the mask processing image is released by the SNS application (step S12).
- the terminal device 41 acquires a mask processing image registered in the SNS without accessing the SNS.
- the terminal device 41 accesses the server 10 based on the address of the mask processing image acquired by any method, and requests the mask processing image without logging in to the SNS (step S20).
- the request for the mask processing image by the terminal device 41 is due to an unauthorized access performed without logging in to the SNS.
- the server 10 does not perform any processing related to the mask in response to the request for the mask processing image due to the unauthorized access. Therefore, the terminal device 41 acquires the masked image as it is after the mask processing, and cannot recognize the original image at the position where the mask processing has been performed.
- the server 10 cancels the masking process of the masked image registered in the SNS by releasing the masked image of the masked image with respect to the request by the regular access made by logging in to the SNS. An image without a mask is used. On the other hand, the server 10 does not cancel the mask processing of the mask processing image for a request due to unauthorized access to the mask processing image without logging in to the SNS.
- the browsing of the masked image and the browsing of the masked image of the image including the specific object registered in the SNS are compatible. It is possible. At this time, the information processing system 1 cancels the processing, that is, the mask processing for the image requested by the user under the management of the SNS, and performs the mask processing for the image requested by the user outside the management of the SNS. Leave it alone. Therefore, it is possible to suppress the spread of, for example, on the Internet, an unmasked image in which mask processing has been canceled from a masked image registered in the SNS.
- FIG. 3 is a block diagram illustrating an example of a hardware configuration of the server 10 applicable to the first embodiment.
- a server 10 includes a CPU (Central Processing Unit) 1000, a ROM (Read Only Memory) 1001, a RAM (Random Access Memory) 1002, a storage 1003, and a communication I / O connected to a bus 1010, respectively.
- F1004 Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- the storage 1003 is a nonvolatile large-capacity storage medium such as a hard disk drive or a flash memory.
- the storage 1003 may be built in the hardware of the server 10 or may be an external storage device for the server 10.
- the CPU 1000 controls the entire operation of the server 10 using the RAM 1002 as a work memory in accordance with programs stored in the ROM 1001 and the storage 1003.
- the program includes a program for providing the SNS described above.
- the communication I / F 1004 controls communication with the network 2 according to an instruction from the CPU 1000.
- FIG. 4 is a block diagram illustrating an example of a hardware configuration of the terminal device 30 applicable to the first embodiment.
- a terminal device 30 includes a CPU 3000, a ROM 3001, a RAM 3002, an imaging unit 3003, a display control unit 3004, a storage 3005, a storage device 3006, an input device 3006, a data I / F 3007 connected to a bus 3010, respectively. , A communication I / F 3008.
- the storage 3005 is a nonvolatile large-capacity storage medium such as a hard disk drive or a flash memory.
- CPU 3000 controls the overall operation of terminal device 30 using RAM 3002 as a work memory according to programs stored in ROM 3001 and storage 3005.
- the program includes the SNS application described above.
- the imaging unit 3003 includes an imaging element, an optical system (such as a lens) for irradiating light from a subject to the imaging element, and a configuration for controlling the imaging element and processing a signal output from the imaging element. .
- the imaging unit 3003 captures a still image or a moving image under the control of the CPU 3000.
- the image captured by the image capturing unit 3003 is stored in the RAM 3002. In the following, unless otherwise specified, the captured image captured by the imaging unit 3003 is a still image.
- the display control unit 3004 generates a display signal that can be displayed by the display device 3020 based on the display control signal generated by the CPU 3000.
- the display device 3020 includes, for example, an LCD (Liquid Crystal Display) and a drive circuit that drives the LCD.
- the input device 3006 for example, a pointing device that outputs coordinate information corresponding to a position touched by a finger or the like can be used. It is preferable that the input device 3006 and the display device 3020 be integrally formed as a so-called touch panel.
- the data I / F 3007 is an interface for exchanging data with an external device.
- USB Universal Serial Bus
- Bluetooth registered trademark
- the communication I / F 3008 controls communication with the network 20 according to an instruction from the CPU 3000.
- FIG. 5 is a block diagram illustrating an example of a hardware configuration of the imaging unit 3003 applicable to the first embodiment.
- the imaging unit 3003 includes a pixel unit 3100, a signal processing unit 3101, a memory unit 3102, an I / F unit 3103, an image processing unit 3104, and an element control unit 3105, and each of these units is a CMOS (Complementary @ Metal).
- CMOS Complementary @ Metal
- This is a CMOS image sensor (CIS) integrally formed using Oxide (Semiconductor).
- the pixel portion 3100 is provided with a plurality of scanning lines and a plurality of signal lines. At an intersection of each scanning line and each signal line, a pixel circuit is arranged, and a plurality of scanning circuits and a plurality of signal lines are provided. A pixel circuit is provided. In the pixel circuit, for example, a photodiode is used as a photoelectric conversion element, and a microlens and a color filter are formed over the photodiode.
- the pixel unit 3100 includes a row scanning circuit, an AD (Analog to digital) converter for each row, and a column scanning circuit.
- each pixel circuit is scanned for each row by a row scanning circuit, and an analog pixel signal output for each row is converted into digital pixel data by an AD converter.
- the pixel data subjected to AD conversion for each row is sequentially transferred to the signal processing unit 3101 by the column scanning circuit.
- the signal processing unit 3101 performs signal processing such as CDS (Correlated Double Sampling) processing, AGC (Auto Gain Control) processing, and WB (White Balance) processing on the pixel data transferred from the pixel unit 3100.
- the image data subjected to signal processing by the signal processing unit 3101 is transferred to the memory unit 3102 and the I / F unit 3103.
- the memory unit 3102 stores the image data processed by the signal processing unit 3101.
- the memory portion 3102 has a capacity capable of storing image data for one frame (for all pixel circuits of the pixel portion 3100), for example.
- the image processing unit 3104 is, for example, a DSP (Digital Signal Processor), and performs predetermined image processing on image data stored in the memory unit 3102.
- the image processing unit 3104 performs a detection process of detecting a predetermined specific object included in an image (captured image) based on the image data stored in the memory unit 3102.
- the image processing unit 3104 detects a specific object using, for example, a detection process based on pattern recognition using a known technique.
- the invention is not limited thereto, and the image processing unit 3104 may detect a specific object by using a technique such as deep learning.
- the image processing unit 3104 writes a detection flag indicating that fact in the memory unit 3102.
- the I / F unit 3103 is an interface that controls communication between the imaging unit 3003 and the outside.
- the I / F unit 3103 can apply an interface corresponding to MIPI (Mobile Industry Processor Interface).
- MIPI Mobile Industry Processor Interface
- the present invention is not limited thereto, and the I / F unit 3103 may apply an interface of a unique method to the imaging unit 3003.
- the I / F unit 3103 outputs the image data transferred from the signal processing unit 3101 or the image data (captured image) stored in the memory unit 3102 to the outside of the imaging unit 3003.
- the I / F unit 3103 externally outputs, for example, designated image data of the image data transferred from the signal processing unit 3101 and the image data stored in the memory unit 3102 in accordance with an instruction from the outside. .
- the element control unit 3105 controls the entire operation of the imaging unit 3003. For example, the element control unit 3105 generates a timing signal for synchronously controlling the operations of the row scanning circuit, the AD converter, and the column scanning circuit in the pixel unit 3100. The element control unit 3105 controls the timing at which the image processing unit 3104 starts image processing.
- the pixel unit 3100, the signal processing unit 3101, the memory unit 3102, the I / F unit 3103, the image processing unit 3104, and the element control unit 3105 included in the imaging unit 3003 have been described as being formed on one substrate.
- the imaging unit 3003 may be a stacked CIS in which a plurality of semiconductor chips are stacked.
- the imaging unit 3003 can be formed with a two-layer structure in which semiconductor chips are stacked in two layers.
- FIG. 6 is a diagram illustrating an example in which the imaging unit 3003 according to the first embodiment is formed by a stacked CIS having a two-layer structure.
- a pixel portion 3100 is formed on a first layer semiconductor chip
- a memory + logic portion 3200 is formed on a second layer semiconductor chip.
- the memory + logic unit 3200 includes, for example, a signal processing unit 3101, a memory unit 3102, an I / F unit 3103, an image processing unit 3104, and an element control unit 3105.
- the first layer semiconductor chip may include the pixel portion 3100 and the signal processing portion 3101.
- the imaging unit 3003 is configured as one solid-state imaging device by bonding the first-layer semiconductor chip and the second-layer semiconductor chip while making electrical contact with each other.
- the imaging unit 3003 can be formed with a three-layer structure in which semiconductor chips are stacked in three layers.
- FIG. 7 is a diagram illustrating an example in which the imaging unit 3003 according to the first embodiment is formed by a three-layer stacked CIS.
- a pixel portion 3100 is formed in a first-layer semiconductor chip
- a memory portion 3102 is formed in a second-layer semiconductor chip
- a logic portion 3201 is formed in a third-layer semiconductor chip.
- the logic unit 3201 includes, for example, a signal processing unit 3101, an I / F unit 3103, an image processing unit 3104, and an element control unit 3105.
- the first layer semiconductor chip may include the pixel portion 3100 and the signal processing portion 3101. As shown on the right side of FIG. 7, the semiconductor chip of the first layer, the semiconductor chip of the second layer, and the semiconductor chip of the third layer are attached to each other while making electrical contact with each other. As a solid-state imaging device.
- FIG. 8 is an example functional block diagram for explaining functions of the terminal device 30 according to the first embodiment.
- the terminal device 30 includes an imaging processing unit 300, an object detection unit 301, an application unit 302, and a communication unit 303.
- the application unit 302 includes an encoding unit 320, a UI unit 321, and an authentication requesting unit 322.
- the imaging processing unit 300 and the object detection unit 301 are functions realized by the imaging unit 3003 described with reference to FIG.
- the imaging processing unit 300 corresponds to the functions of the pixel unit 3100, the signal processing unit 3101, and the element control unit 3105 in FIG.
- the object detection unit 301 corresponds to the functions of the memory unit 3102 and the image processing unit 3104 in FIG.
- the function of the application unit 302 is, for example, a function realized by the above-described SNS application.
- a program (SNS application) for realizing each function in the application unit 302 (the encoding unit 320, the UI unit 321 and the authentication requesting unit 322) in the terminal device 30 is stored on a computer connected to a network such as the Internet, It is provided by being downloaded via the network. Further, the program may be provided or distributed via a network such as the Internet. Further, the program is provided in an installable or executable format on a computer-readable recording medium such as a CD (Compact Disk), a flexible disk (FD), or a DVD (Digital Versatile Disk). May be.
- CD Compact Disk
- FD flexible disk
- DVD Digital Versatile Disk
- the program has a module configuration including an encoding unit 320, a UI unit 321 and an authentication requesting unit 322.
- a module configuration including an encoding unit 320, a UI unit 321 and an authentication requesting unit 322.
- the CPU 3000 reads out the program from a storage medium such as the ROM 3001 or the storage 3005 and executes the program, the above-described units are loaded onto the main storage device such as the RAM 3002, and the encoding unit 320 and the UI unit 321 are loaded.
- the authentication request unit 322 is generated on the main storage device.
- the encoding unit 320 performs an encoding process such as compression encoding on the captured image output from the imaging unit 3003.
- a JPEG Joint Photographic Experts Group
- an image is divided into blocks of a fixed size (for example, 8 pixels ⁇ 8 pixels), and discrete cosine transform is performed in block units to convert image information from a spatial domain to information in a frequency domain.
- this block is called a DCT (Discrete Cosine Transform) block.
- the encoding unit 320 performs a quantization process and a Huffman compression process on the image converted into the information in the frequency domain, reduces the amount of information, and compression-encodes the original image.
- the encoding unit 320 stores the compression-encoded image in a file in a predetermined format. At this time, the encoding unit 320 can further store the metadata regarding the image in the file.
- the encoding unit 320 can store the compression-encoded image in an Exif (Exchangeable image file format) file.
- the metadata is stored in an application marker segment area defined in the Exif format.
- a UI (User Interface) unit 321 provides a user interface for user operation.
- the UI unit 321 generates a display control signal for causing the display device 3020 to display an operation screen.
- the UI unit 321 receives a user operation on the input device 3006, and controls the operation of each unit (for example, the imaging unit 3003 and the authentication request unit 322) of the terminal device 30 according to the user operation.
- the authentication request unit 322 transmits authentication information (account information) for logging in to the SNS and an authentication request for the authentication information to the server 10 and requests authentication of the terminal device 30.
- the authentication request unit 322 can, for example, nonvolatilely store account information input by the user 31 in a predetermined area of the storage 3005.
- the authentication requesting unit 322 can automatically transmit the stored account information to the server 10 when the SNS application is activated.
- the communication unit 303 performs communication with the network 2 under the control of the UI unit 321.
- the communication unit 303 transmits the captured image encoded by the encoding unit 320 and stored in the file, and the account information by the authentication requesting unit 322.
- FIG. 9 is an example functional block diagram for explaining the function of the server 10 according to the first embodiment.
- the server 10 includes a communication unit 100, an authentication unit 101, a decoding unit 102, an analysis unit 103, a mask processing unit 104, and a storage unit 105.
- the communication unit 100, the authentication unit 101, the decoding unit 102, the analysis unit 103, the mask processing unit 104, and the storage unit 105 are realized by a program operating on the CPU 1000.
- the present invention is not limited to this, and some or all of the communication unit 100, the authentication unit 101, the decoding unit 102, the analysis unit 103, the mask processing unit 104, and the storage unit 105 are configured by hardware circuits operating in cooperation with each other. Is also good.
- the communication unit 100 performs communication with the network 2.
- the authentication unit 101 performs an authentication process in response to an authentication request including account information received by the communication unit 100.
- the decoding unit 102 decodes the image received by the communication unit 100 to decode the compression code, and acquires metadata added to the image.
- the analysis unit 103 analyzes the decoded image decoded by the decoding unit 102, and detects a specific object included in the decoded image.
- the mask processing unit 104 performs a mask process on the image according to the analysis result of the analysis unit 103. At this time, the mask processing unit 104 can perform a mask process on the compression-encoded image before being decoded by the decoding unit 102. The mask processing unit 104 also cancels the mask processing performed on the image. The mask processing unit 104 performs a mask process and a mask release process according to the authentication result of the authentication unit 101.
- the storage unit 105 stores the image output from the mask processing unit 104 in, for example, the storage 1003.
- the storage unit 105 also performs a process of reading an image from the storage 1003.
- a process in which the storage unit 105 stores an image in the storage 1003 is described as “store an image in the storage unit 105”, and a process of reading an image from the storage 1003 is referred to as “storage unit 105”. Read the image from. "
- a program for realizing each function according to the first embodiment in the server 10 is a file in an installable format or an executable format in a CD (Compact Disk), a flexible disk (FD), and a DVD (Digital Versatile Disk).
- the program is provided by being recorded on a computer-readable recording medium such as a computer.
- the program may be stored on a computer connected to a network such as the Internet, and provided by being downloaded via the network. Further, the program may be provided or distributed via a network such as the Internet.
- the program has a module configuration including a communication unit 100, an authentication unit 101, a decoding unit 102, an analysis unit 103, a mask processing unit 104, and a storage unit 105.
- a communication unit 100 As actual hardware, when the CPU 1000 reads out the program from a storage medium such as the ROM 1001 or the storage 1003 and executes the program, the above-described units are loaded on the main storage device such as the RAM 1002, and the communication unit 100 and the authentication unit 101 , A decoding unit 102, an analysis unit 103, a mask processing unit 104, and a storage unit 105 are generated on a main storage device.
- FIG. 10 is an example flowchart illustrating upload processing of a captured image by the terminal device 30 according to the first embodiment.
- the terminal device 30 Prior to execution of the processing according to the flow of FIG. 10, the terminal device 30 is loaded with application software (SNS application) corresponding to a service (for example, SNS) provided by the information processing system 1 according to the first embodiment.
- SNS application application software
- SNS service
- step S100 the SNS application is started in the terminal device 30 in response to a user operation.
- the authentication requesting unit 322 transmits account information to the server 10 and requests authentication.
- the server 10 performs authentication based on the account information transmitted from the terminal device 30 by the authentication unit 101.
- the SNS provided by the server 10 can be used from the terminal device 30.
- the terminal device 30 performs imaging by the imaging processing unit 300 in response to a user operation instructing imaging (step S101).
- the captured image obtained by the imaging is passed to the object detection unit 301.
- the terminal device 30 causes the object detection unit 301 to execute a specific object detection process on the captured image passed from the imaging processing unit 300.
- the specific object is, for example, an image from which personal information can be specified, and a face, a license plate of a vehicle, an open window, or the like can be applied.
- the object detection unit 301 detects a specific object using a detection method based on known pattern recognition. Note that the specific object detection process may be executed by the object detection unit 301 and the CPU 3000 of the terminal device 30 in cooperation with each other.
- the captured image captured and acquired in step S101 is applied as the target of the specific object detection in step S102, but this is not limited to this example.
- the terminal device 30 may perform a specific object detection by the object detection unit 301 in step S102 on a captured image that is captured by the imaging unit 3003 and stored in the storage 3005 or the like.
- the object detection unit 301 executes a specific object detection process on a captured image read from the storage 1003 in response to a user operation or the like.
- step S103 the terminal device 30 determines whether or not the object detection unit 301 has detected a specific object from the captured image.
- the object detection unit 301 shifts the processing to step S104.
- step S104 the terminal device 30 causes the object detection unit 301 to add a detection flag indicating that a specific object has been detected to the captured image.
- the detection flag is, for example, a value “1” indicating that a specific object has been detected, and a value “0” indicating that the specific object has not been detected.
- the default value of the detection flag is “0”.
- step S104 the value of the detection flag is changed from “0” to “1”. As described above, when the object detection processing is executed in cooperation with the object detection unit 301 and the CPU 3000, the detection flag may be added by the object detection unit 301 or may be added by the CPU 3000.
- FIGS. 11 and 12 are diagrams schematically illustrating a state where a specific object is detected from a captured image, which is applicable to the first embodiment.
- FIG. 11 shows an example where the specific object is a face.
- each rectangular area 51a including a face is detected as a specific object area.
- FIG. 12 shows an example in which a specific object is an open window.
- each rectangular area 51b including the open window is detected as the specific object area.
- step S103 when it is determined in step S103 that no specific object is detected from the captured image (step S103, “No”), the object detection unit 301 skips the processing of step S104 and shifts the processing to step S105. Let it. In this case, the value of the detection flag is maintained at “0”.
- step S105 the terminal device 30 performs an encoding process on the captured image acquired in step S101 by the encoding unit 320.
- the encoding unit 320 compresses and encodes the captured image according to the JPEG method and stores the compressed and encoded image in an Exif format file.
- the encoding unit 320 includes the detection flag in the metadata of the captured image and stores the detection flag in the application marker segment area defined in the Exif format.
- the terminal device 30 transmits the captured image encoded in step S105 and stored in the file to the server 10 by the communication unit 303 in response to a user operation.
- the specific object detection is performed on the still image, but this is not limited to this example.
- the processing according to the flowchart of FIG. 10 may be processing for a moving image.
- the terminal device 30 causes the object detection unit 301 to execute a specific object detection process for each frame of the moving image.
- the object detection unit 301 adds a detection flag of a value “1” to the frame in which the specific object is detected (“Yes” in step S103) as metadata of the frame (step S104). .
- step S105 the terminal device 30 uses the encoding unit 320 to convert the moving image H.264 (ITU-T Rec. H.264
- the detection flag is described as being added as metadata to each frame. However, this is not limited to this example. For example, data in which detection flags for a plurality of frames are associated with frame numbers is separately created, and The data may be added to the moving image data.
- the terminal device 30 may transmit the moving image as a file to the server 10 or may transmit the moving image as stream data.
- FIG. 13 is a flowchart illustrating an example of a process performed by the server 10 according to the first embodiment.
- the server 10 uses the communication unit 100 to detect access via the network 2.
- the server 10 determines whether the access detected by the authentication unit 101 in step S200 is an access from an access source that has received the authentication request.
- the server 10 ends the series of processes in the flowchart of FIG. Let it. Not limited to this, the authentication unit 101 may request account information for the access and prompt authentication processing.
- step S200 determines that the access detected in step S200 is an access for which the authentication request has been received (step S201, “Yes”)
- step S202 the authentication unit 101 determines whether the authentication for the received authentication request is successful. If the authentication unit 101 determines that the authentication for the received authentication request has not been successful (step S202, “NG”), the authentication unit 101 ends the series of processes in the flowchart of FIG.
- step S203 the server 10 determines, for example, by the communication unit 100, which of the access detected in step S200 requires registration or acquisition of an image. If the communication unit 100 determines that the access detected in step S200 is a request for image registration (step S203, “Registration”), the process proceeds to step S204. On the other hand, when the communication unit 100 determines that the access detected in step S200 is a request to acquire an image (step S203, “acquisition”), the server 10 shifts the processing to step S210.
- step S203 If the communication unit 100 determines in step S203 that the access detected in step S200 is neither registration nor acquisition of an image, the communication unit 100 ends a series of processes in the flowchart of FIG. 13 and proceeds to another process. Can be migrated.
- step S204 the server 10 receives, by the communication unit 100, the file storing the image transmitted from the access source whose access has been detected in step S200.
- the access source is, for example, the terminal device 30, and the communication unit 100 receives the file storing the captured image transmitted in step S106 in the flowchart of FIG.
- the server 10 causes the decoding unit 102 to extract and decode the compression-encoded captured image from the file received in step S204, thereby decoding the captured image.
- the decoded decoded image is bitmap data having luminance information and color information for each pixel.
- the decoding unit 102 also stores the compression-encoded captured image stored in the file.
- the decoding unit 102 acquires metadata from the file.
- step S206 the server 10 uses the decoding unit 102 to determine whether or not the metadata acquired in step S205 includes a detection flag indicating that the specific object has been detected.
- the decoding unit 102 determines that the detection flag is not included (step S206, “No”), the process proceeds to step S209.
- the decoding unit 102 determines that the detection flag is included (step S206, “Yes”), the decoding unit 102 shifts the processing to step S207.
- step S207 the server 10 analyzes the captured image decoded in step S205 by the analysis unit 103, detects all detectable specific objects from the captured image, and identifies each detected specific object. Get the containing rectangular area.
- the analysis unit 103 passes the acquired coordinates of a rectangular area (hereinafter, referred to as a specific object area) including all the specific objects to the mask processing unit 104.
- the server 10 uses the mask processing unit 104 to store the compression-encoded captured image held by the decoding unit 102 in step S204 based on the coordinates of the specific object area passed from the analysis unit 103.
- a reversible mask process is performed on an area corresponding to the specific object area.
- FIG. 14 is a diagram illustrating an example in which mask processing is performed on each rectangular area 51a included in the above-described captured image 50a illustrated in FIG. 11 according to the first embodiment. 14, in the captured image 50a ', each rectangular area 52a corresponding to each rectangular area 51a in FIG. 11 is masked, and the face included in each rectangular area 51a is unknown.
- FIG. 15 is a diagram illustrating an example in which mask processing is performed on each rectangular area 51b included in the captured image 50b illustrated in FIG. 12 described above according to the first embodiment. In the captured image 50b 'in FIG. 15, a mask is applied to each of the rectangular regions 52b corresponding to each of the rectangular regions 51b in FIG. 12, and an open window included in each of the rectangular regions 51b is unknown.
- an object that can specify personal information and is included in the original captured images 50a and 50b can be made indistinguishable.
- the reversible mask processing by the mask processing unit 104 will be described using a more specific example.
- the mask processing unit 104 rearranges the information in the rectangular area in the image, thereby making it difficult to determine the information in the rectangular area and masking the rectangular area. Also, by rearranging the information in the masked rectangular area in the original order, the mask can be released and the information in the rectangular area can be returned to the original easily identifiable information.
- the mask processing unit 104 rearranges the information in the rectangular area, for example, by encrypting the information in the rectangular area.
- the mask processing unit 104 encrypts information in the rectangular area using a key given in advance, masks the information, decrypts the encryption in the rectangular area using the key, and decrypts the information in the rectangular area. In the original order.
- a method of rearranging information by performing replacement and transposition according to a predetermined key can be applied.
- encryption using a hash function such as SHA-1 (Secure @ Hash @ Algorithm-1) or MD5 (Message @ Digest @ Algorithm @ 5) may be used.
- an image 50c is a bitmap image and includes a face 501 as a specific object.
- compression encoding is performed in units of DCT blocks having a fixed size of 8 pixels ⁇ 8 pixels.
- the image 50c is divided into blocks of 8 ⁇ 8 pixels corresponding to DCT blocks, and a rectangular area 502 including a plurality of blocks 500 including a face 501 is extracted. It is conceivable that data compressed and encoded by the JPEG method is encrypted in units of DCT blocks corresponding to the blocks 500 included in the rectangular area 502.
- the mask processing unit 104 performs the mask processing for each specific object area.
- the present invention is not limited to this example.
- the mask processing unit 104 may encrypt the entire captured image included in the file received in step S204. Further, the mask processing unit 104 can also encrypt the file itself received in step S204.
- the mask processing unit 104 has been described to perform the mask processing on the compression-encoded captured image, but this is not limited to this example.
- the mask processing unit 104 performs a mask process on the captured image decoded as the bitmap image in step S205, and compresses the captured image of the bitmap image subjected to the mask process again by the JPEG method or the like. It may be.
- step S208 when the mask processing is performed by the mask processing unit 104 in step S208, the server 10 shifts the processing to step S209.
- step S209 the server 10 receives the captured image (image file) on which the mask processing has been performed in step S208 by the storage unit 105, or receives the image in step S204 if the processing has shifted from step S206 to step S209.
- the captured image (image file) is stored in, for example, the storage 1003, and the captured image is registered in the SNS.
- the storage unit 105 stores the information indicating the position of each specific object area detected in step S207 in the storage 1003 in association with the captured image.
- the server 10 decodes the compression code of the moving image received in step S205 by the decoding unit 102, and generates a bitmap image for each frame. Is generated (step S205).
- the server 10 also detects the specific object area by the analysis unit 103 for each frame that is a bitmap image, based on the detection flag acquired by the decoding unit 102 and added to the moving image as metadata (step S206, step S207).
- the server 10 performs a mask process on the detected specific object region by the mask processing unit 104 (Step S208).
- the server 10 transmits the moving image including each frame, which is a bitmap image, subjected to the mask processing in step S208 by the storage unit 105, for example, to the H.264 image.
- the compression-encoded moving image is stored in the storage 1003, and the moving image is registered in the SNS (step S209).
- the present invention is not limited to this, and the server 10 may store the moving image in which each frame is a bitmap image, which is not subjected to the compression encoding, in the storage 1003.
- the storage unit 105 stores information indicating the position of each specific object area detected in each frame in the storage 1003 in association with each frame.
- step S203 if it is determined that the access detected in step S200 is a request to acquire an image (step S203, “acquisition”), the process proceeds to step S210.
- step S210 the storage unit 105 in the server 10 acquires a file in which the captured image requested to be acquired is stored, for example, from a registered image stored in the storage 1003 and registered in the SNS.
- step S211 the server 10 determines whether or not the metadata stored in the file acquired in step S210 includes a detection flag indicating that the specific object has been detected by the mask processing unit 104. I do.
- step S211 “No”
- the process proceeds to step S213.
- Step S212 the mask processing unit 104 cancels the mask applied to the captured image based on the information indicating the position of the specific object area associated with the captured image acquired in step S210.
- the mask processing unit 104 decrypts the encryption when the mask is applied to the specific object area in the captured image by encryption.
- the captured image can be viewed in a state where the image is not masked and has been received in step S204.
- the server 10 causes the communication unit 100 to include, in the access source whose access has been detected in step S200, the captured image acquired in step S210 (a detection flag indicating that the specific object has been detected). If no, the captured image (if the detection flag is included) whose mask has been released in step S212 is transmitted. When the captured image is transmitted, a series of processes in the flowchart of FIG. 13 ends.
- step S200 is an access from an access source that has not been authenticated in the authentication process by the server 10 (for example, an unauthorized access from the terminal device 41)
- the process in step S211 is not performed. Therefore, when a captured image registered in the SNS is acquired due to unauthorized access, the acquired captured image remains masked, and an image included in the specific object area cannot be identified. Therefore, diffusion of personal information included in the specific object area can be suppressed.
- the server 10 uses the decoding unit 102 to decode the moving image acquired from the registered image in step S210. It decodes the compression code to generate a bitmap image for each frame, and acquires a detection flag added as metadata added to the moving image. If the image requested to be acquired is a moving image stored in the storage 1003 without being compression-encoded, the decoding process of the compression code is omitted.
- the server 10 determines the frame based on the information indicating the position of the specific object area associated with the frame. Is released (step S212). The server 10 sends each frame whose mask has been released by, for example, the mask processing unit 104 to H.264.
- the data is compression-encoded by a predetermined method such as the H.264 method and transmitted (step S213).
- FIG. 17 is a sequence chart illustrating an example of an entire operation of the information processing system 1 according to the first embodiment.
- the terminal device 30 transmits a still image captured by the image capturing unit 3003 as a still image to the server 10.
- the application unit 302 transmits account information to the server 10 by the authentication request unit 322, and requests the server 10 for authentication (step S300). Step S301). If the account information transmitted from the terminal device 30 is appropriate, the server 10 notifies the terminal device 30 of the authentication (step S302). Thus, the SNS function provided by the server 10 can be used from the terminal device 30.
- imaging is performed by the imaging processing unit 309 of the imaging unit 3003 in response to a user operation, and a captured image is obtained (step S303).
- the imaging unit 3003 detects the specific object from the captured image acquired by the imaging using the object detection unit 301 (step S304).
- the object detection unit 301 adds a detection flag indicating that the specific object is detected to the captured image (step S305), and adds the detection image to which the detection flag has been added.
- the information is passed to the application unit 302.
- the captured image is passed to the encoding unit 320 in the application unit 302.
- the terminal device 30 performs an encoding process on the captured image passed from the object detection unit 301 by the encoding unit 320 (step S306).
- This encoding process compression and encoding are performed on the captured image by, for example, the JPEG method, and metadata including a detection flag is added.
- the encoding unit 320 stores each of the encoded data in a file in a predetermined format (for example, an Exif format) and passes the data to the communication unit 303.
- the communication unit 303 transmits the file in which the data passed from the encoding unit 320 is stored to the server 10 according to, for example, a user operation, and uploads a captured image to the server 10 (Step S307).
- the decoding unit 102 When the server 10 receives the file containing the captured image uploaded from the terminal device 30, the decoding unit 102 performs a decoding process on the received file (step S310). That is, the decoding unit 102 acquires metadata from the received file. At the same time, the decoding unit 102 decodes the compression-encoded captured image stored in the file. The decoding unit 102 passes the decoded captured image to the analysis unit 103 and holds the captured image before decoding.
- the server 10 causes the analysis unit 103 to execute the decoding passed from the decoding unit 102.
- the captured image is analyzed, and all detectable specific objects included in the decoded captured image are detected (step S311).
- the analysis unit 103 passes position information indicating the position of the specific object detected from the decoded captured image to the mask processing unit 104.
- the mask processing unit 104 performs a mask process on the captured image (compression-coded captured image) before decoding, which is stored in the decoding unit 102, based on the position information passed from the analysis unit 103 (step S312). ).
- the server 10 registers the captured image subjected to the mask processing in the SNS.
- steps S320 to S324 show an example of processing in a case where the server 10 is accessed by regular access to log in to the SNS and a captured image registered in the SNS is acquired.
- account information is transmitted from the SNS application to the server 10 from, for example, the terminal device 40 on which the SNS application is mounted, and authentication is requested (step S320).
- the server 10 notifies the terminal device 40 that the authentication has been performed (step S321). Thereby, the function of the SNS provided by the server 10 can be used from the terminal device 40.
- the terminal device 40 requests the server 10 to browse the captured image registered in the SNS by the SNS application in response to, for example, a user operation (step S322).
- the server 10 releases the mask applied to the captured image registered in the SNS (Step S323).
- the server 10 transmits the captured image with the mask removed to the terminal device 40 (Step S324).
- the terminal device 40 decodes the captured image, decodes the compression code, and displays it on the display. Since the mask on the specific object has been released from the captured image, the captured image can be viewed on the terminal device 40 so that the specific object can be identified.
- steps S330 to S332 show an example of processing in a case where the server 10 is accessed by unauthorized access to acquire a captured image registered in the SNS without logging in to the SNS.
- the terminal device 41 accesses the server 10 without sending the account information and requests for authentication, and accesses the server 10 without authentication by the server 10 and requests a captured image to be registered in the SNS (step S330). .
- the server 10 does not release the mask applied to the captured image for a request from an unauthorized access source (step S331). Therefore, the terminal device 41 acquires the captured image with the mask applied (step S332). In the captured image, since the specific object remains masked, the specific object cannot be identified in the captured image viewed on the terminal device 41. Therefore, even if the captured image leaks from the terminal device 41 to, for example, the Internet, it is possible to prevent the personal information included in the specific object from being diffused.
- the processing (mask processing) on the registered image is canceled or the processing is performed as it is, depending on whether the access to the server 10 is the regular access or the unauthorized access. Can be controlled, and both the processed and non-processed states of the image can be compatible. In addition, since the image is kept processed for unauthorized access, the diffusion of, for example, personal information contained in the image before the processing can be suppressed.
- the terminal device 30 detects whether or not at least one specific object is included in the captured image (FIG. 10, step S103), and the server 10 determines whether or not the captured image includes at least one specific object. Is included, the captured image is analyzed to detect the specific object region (FIG. 13, step S207). This is not limited to this example, and the terminal device 30 may detect all the specific objects that can be detected from the captured image.
- the terminal device 30 acquires a specific object area and its coordinates for all detected specific objects (for example, step S103 in FIG. 10).
- the terminal device 30 adds the acquired coordinates of all the specific object areas as metadata to the captured image (for example, step S104 in FIG. 10).
- step S207 in FIG. 13 the processing of step S207 in FIG. 13 (step S311 in FIG. 17) can be omitted.
- the mask processing unit 104 performs a mask process on each specific object area based on the coordinates of each specific object area included in the metadata added to the captured image (step S207 in FIG. 13 and FIG. 17). Step S312).
- the terminal device 30 acquires each specific object area included in the captured image, so that the load of the server 10 is reduced with respect to the processing of the first embodiment described above. It is possible to reduce.
- the server 10 registers a captured image on which reversible mask processing has been performed, and releases the mask of the captured image for regular access.
- the server 10 registers the captured image without performing the masking process, and performs the masking process on the captured image in response to an acquisition request of the captured image due to unauthorized access. I have to.
- the mask processing can use an irreversible method.
- FIG. 18 is an example flowchart illustrating a process in the server 10 according to the second embodiment. Note that in FIG. 18, processes common to the above-described flowchart of FIG. 13 are denoted by the same reference numerals. Further, the processing of the terminal device 30 when the captured image is registered in the SNS provided by the server 10 can apply the processing described in FIG. 10 as it is.
- step S200 the server 10 detects access via the network 2 by the communication unit 100, and in the next step S201, the authentication unit 101 determines that the access detected in step S200 is an authentication request. Is determined to be an access from an access source that has already received.
- step S200 determines whether the access detected in step S200 is an access for which the authentication request has been received. If the authentication unit 101 determines that the authentication for the received authentication request has not been successful (step S202, “NG”), the series of processes in the flowchart of FIG. 18 ends.
- step S203 the server 10 determines, for example, by the communication unit 100, which of the access detected in step S200 requires registration or acquisition of an image. If the communication unit 100 determines that the access detected in step S200 is a request for image registration (step S203, “Registration”), the process proceeds to step S204. On the other hand, if the communication unit 100 determines that the access detected in step S200 is a request to acquire an image (step S203, “acquisition”), the process proceeds to step S210.
- step S204 the server 10 receives, by the communication unit 100, the file storing the image transmitted from the access source whose access has been detected in step S200.
- the access source is, for example, the terminal device 30, and the communication unit 100 receives the file storing the captured image transmitted in step S106 in the flowchart of FIG.
- the server 10 causes the decoding unit 102 to extract and decode the compression-encoded captured image from the file received in step S204, thereby decoding the captured image.
- the decoding unit 102 also stores the compression-encoded captured image stored in the received file.
- the decoding unit 102 acquires metadata from the file.
- step S206 the server 10 uses the decoding unit 102 to determine whether or not the metadata acquired in step S205 includes a detection flag indicating that the specific object has been detected. If the decoding unit 102 determines that the detection flag is not included (step S206, “No”), the process proceeds to step S209 ′. On the other hand, when the decoding unit 102 determines that the detection flag is included (step S206, “Yes”), the decoding unit 102 shifts the processing to step S207.
- step S207 the server 10 analyzes the captured image decoded in step S205 by the analysis unit 103, and detects a specific object region from the captured image.
- the analysis unit 103 holds the coordinates of the detected specific object area in association with the captured image.
- the process proceeds to step S209 '.
- the mask processing on the detected specific object area in step S208 in FIG. 13 is not executed when a captured image is registered.
- the server 10 stores in the storage unit 105 the captured image (image file) received in step S204 and the coordinates of the specific object area associated with the captured image in step S207. To be stored.
- the captured image is registered in the SNS, a series of processing according to the flowchart in FIG. 18 ends.
- step S203 if it is determined that the access detected in step S200 is a request to acquire an image (step S203, “acquisition”), the process proceeds to step S210.
- the server 10 acquires, from the storage unit 105, a file in which the captured image requested to be acquired is stored, for example, from a registered image stored in the storage 1003 and registered in the SNS.
- step S210 When the registered image is obtained in step S210, the process proceeds to step S213. That is, in the second embodiment, since the registered image has not been subjected to the mask processing, the determination processing based on the detection flag in step S211 in FIG. 13 and the mask release processing in step S212 are omitted.
- step S213 the server 10 causes the communication unit 100 to transmit the captured image acquired in step S210 to the access source whose access has been detected in step S200.
- the captured image is transmitted, a series of processes in the flowchart of FIG. 18 ends.
- step S201 when the authentication unit 101 determines that the access detected in step S200 is not an access for which the authentication request has been received (step S201, “No”), the server 10 proceeds to step S220. Migrate.
- step S220 the server 10 determines, for example, by the communication unit 100, whether the access detected in step S200 is a request to acquire an image. If the communication unit 100 determines that the access does not request acquisition of an image (step S220, “No”), the communication unit 100 ends the series of processes in the flowchart of FIG.
- step S220 when the communication unit 100 determines that the access is a request for acquiring an image (step S220, “Yes”), the server 10 shifts the processing to step S221.
- step S221 the server 10 acquires, by the mask processing unit 104, a captured image requested from the access source of the access detected in step S200 among the captured images registered in step S209 '.
- the server 10 performs a mask process on the acquired captured image in a region corresponding to the specific object in the captured image based on the coordinates of the specific object associated with the captured image.
- the server 10 causes the communication unit 100 to transmit the captured image subjected to the mask processing to the access source of the access detected in step S200.
- step S222 When the captured image subjected to the mask processing is transmitted in step S222, a series of processing according to the flowchart in FIG.
- the present invention is not limited to this, and the entire captured image may be replaced with a solid image or the like. The same applies to the case where the captured image is a moving image.
- the captured image acquired by unauthorized access to the SNS is masked and included in the specific object area.
- the image cannot be identified. Therefore, diffusion of personal information included in the specific object area can be suppressed.
- the mask processing for the area of the captured image corresponding to the specific object area irreversible, it becomes impossible for the receiving side of the captured image to identify the image included in the specific object area. Therefore, diffusion of personal information included in the specific object area can be more effectively suppressed.
- the registered captured image since the registered captured image itself is not subjected to the masking process, the registered captured image is accessed without logging in to the SNS by any method, for example. In such a case, an original captured image may be obtained. Therefore, it is preferable to separately take measures against unauthorized access.
- FIG. 19 is an example sequence chart illustrating an overall operation of the information processing system 1 according to the second embodiment.
- the terminal device 30 transmits a still image captured by the image capturing unit 3003 as a still image to the server 10.
- the processing in steps S300 to S310 is the same as the processing described with reference to FIG. Therefore, the description here is omitted.
- the mask processing of step S312 in FIG. 17 is omitted.
- steps S320 to S324 show an example of processing in a case where the terminal device 40 accesses the server 10 by regular access, logs in to the SNS, and acquires a captured image registered in the SNS, for example. ing.
- the process of FIG. 19 omits the process of unmasking in step S323 in FIG.
- the processing in steps S320 to S322 is the same as the processing in steps S320 to S322 in FIG. 17, and a description thereof will be omitted.
- the server 10 uses the communication unit 100 in step S324 ′.
- the captured image requested by the terminal device 40 is transmitted (step S324).
- the terminal device 40 decodes the captured image, decodes the compression code, and displays it on the display. Since the captured image has not been subjected to the mask processing, the captured image can be viewed on the terminal device 40 so that the specific object can be identified.
- steps S340 to S342 show an example of processing when the server 10 is accessed by unauthorized access to acquire a captured image registered in the SNS without logging in to the SNS.
- the terminal device 41 accesses the server 10 without transmitting the account information and requests for authentication, and accesses the server 10 without authentication by the server 10 and requests a captured image to be registered in the SNS (step S340). .
- the server 10 performs irreversible mask processing on the requested captured image by the mask processing unit 104 (step S341). Therefore, the terminal device 41 obtains the captured image irreversibly masked and masked (step S342). In the captured image, since the specific object is masked irreversibly, the specific object cannot be identified in the captured image viewed on the terminal device 41. Therefore, even if the captured image leaks from the terminal device 41 to, for example, the Internet, it is possible to prevent the personal information included in the specific object from being diffused.
- the requested image is processed (masked) or processed according to whether the access to the server 10 is the authorized access or the unauthorized access. Can be controlled, and the processed and non-processed states of the image can be compatible. Further, for unauthorized access, since the image is irreversibly processed, the diffusion of, for example, personal information contained in the image before the processing can be suppressed.
- the process of detecting all the specific objects detectable from the captured image in the terminal device 30 described in the modification of the first embodiment described above is also a modification. It is possible to apply.
- FIG. 20 is a diagram illustrating an example of a configuration of an information processing system according to the third embodiment.
- an information processing system 1 'according to the third embodiment includes a server 10 and a server 11.
- the server 10 provides the SNS (service #A) described in the first embodiment or the second embodiment.
- service #A the SNS described in the first embodiment
- the server 11 provides the service #B.
- the service #B is used by performing an authentication process, and may be an SNS or another service.
- the service #B is an SNS different from the service #A.
- the service #A and the service #B cooperate.
- a user who has logged in to the server 11 and has become able to use the service #B is provided by the server 10 without an explicit log-in process to the server 10.
- Service #A can be used.
- the user 31 accesses the server 10 from the terminal device 30 and logs in to the service #A, and registers an image captured by the terminal device 30 in the service #A.
- the terminal device 30 registers the captured image in the storage 1003 of the server 10 by, for example, the processing of steps S300 to S312 in FIG.
- the server 10 performs a mask process on the captured image for the specific object area included in the captured image, stores the masked image in the storage 1003, and registers the captured image in the service #A.
- the terminal device 40 has an SNS application (B) for using the service #B.
- the functional configuration of the terminal device 40 is equivalent to the configuration described with reference to FIG. 8, and the function of the SNS application (B) is also equivalent to the function of the application unit 302 in FIG.
- the user 42 activates the SNS application (B) in the terminal device 40, transmits account information of the service #B to the server 11, and requests authentication.
- the terminal device 40 logs in to the service #B.
- the function of the service #B can be used from the terminal device 40.
- the service #B cooperates with the service #A, and the terminal device 40 becomes able to use the function of the service #A by logging in to the service #B in cooperation with the services. And In this case, the terminal device 40 can acquire the captured image stored in the storage 1003 and registered in the service #A via the service #B.
- the terminal device 40 When the server 10 receives the acquisition request for the captured image registered in the service #A via the service #B (server 11), the terminal device 40 performs the authentication processing in step S320 and step S321 in FIG. 17, for example. Then, it is considered that the acquisition request for the captured image has been transmitted. Therefore, the server 10 releases the mask applied to the specific object area of the captured image according to the process of step S322 in FIG. 17, and transmits the unmasked captured image to the terminal device via the service #B (server 11). Send to 40. This allows the terminal device 40 to browse the captured image so that the specific object can be identified.
- a captured image registered in the service #A is acquired from the terminal device 41 without logging in to either the service #A or the service #B.
- the server 10 does not release the mask applied to the captured image for a request from an unauthorized access source. Therefore, the terminal device 41 acquires the captured image with the mask applied, and cannot identify the specific object in the captured image viewed on the terminal device 41. Therefore, even if the captured image leaks from the terminal device 41 to, for example, the Internet, it is possible to prevent the personal information included in the specific object from being diffused.
- the present disclosure is applicable to a case where a plurality of services cooperate.
- An image sensor that converts received light into an image
- An image processing unit that detects a specific object with respect to the image, An output interface for outputting the image
- a solid-state imaging device comprising: A first communication unit that transmits an image output from the output interface;
- a terminal device comprising: A second communication unit;
- a processor An information processing device comprising: Has, The processor comprises: The image transmitted from the terminal device is received by the second communication unit, When the image received by the second communication unit is an image in which the specific object is detected by the image processing unit, an information processing system that performs a mask process for masking the specific object.
- the processor comprises: The image in which the specific object is masked is stored in a storage unit, Upon receiving an access request for the image stored in the storage unit, determine whether the source of the access request is permitted to access the image, The information processing system according to (1), wherein when it is determined that access to the image is permitted, the mask is released. (3) The processor comprises: The information processing system according to (1) or (2), wherein the specific object is reversibly masked by the mask processing. (4) The processor comprises: The information processing system according to any one of (1) to (3), wherein the specific object is masked by encrypting a predetermined area including the specific object in the image in which the specific object is detected. .
- the processor comprises: Storing the received image in a storage unit, Upon receiving an access request for the image stored in the storage unit, determine whether the source of the access request is permitted to access the image, The information processing system according to (1), wherein when it is determined that access to the image is not permitted, mask processing for masking the specific object of the image is performed.
- the processor comprises: The information processing system according to (5), wherein the specific object is irreversibly masked by the mask processing.
- the image processing unit When the specific object is detected from the image output from the image sensor, adding detection information indicating that the specific object has been detected to the image,
- the first communication unit includes: Transmitting the image to which the detection information is added,
- the processor comprises: The information according to any one of (1) to (6), wherein the specific object included in the image is masked when the detection information is added to the image received by the second communication unit. Processing system.
- the processor comprises: When the detection information is added to the image received by the second communication unit, position information indicating a position of the specific object in the image is obtained, and the specific object is identified based on the position information.
- the information processing system according to (7), wherein masking is performed.
- the image processing unit Detecting the specific object from the image output from the image sensor, to obtain position information indicating the position of the detected specific object on the image
- the first communication unit includes: To the image output from the output interface, adding the position information as the detection information and transmitting,
- the processor comprises: The information processing system according to (7), wherein the specific object included in the image is masked based on the position information added to the image communicated by the second communication unit.
- the information processing device The information processing system according to any one of (1) to (9), including a plurality of information processing devices operating in cooperation.
- the image processing unit Detecting the specific object from the image output from the image sensor, to obtain position information indicating the position of the detected specific object on the image, The communication unit, The terminal device according to (12), wherein the position information is added to the image output from the output interface as the detection information and transmitted.
- a processor A communication unit that performs detection of a specific object with respect to an image in which light received by the image sensor is converted, and performs communication with a terminal device that transmits the image. With The processor comprises: The image transmitted from the terminal device is received by the communication unit, When the image received by the communication unit is an image in which the specific object is detected by the terminal device, an information processing apparatus that performs a mask process for masking the specific object.
- the processor comprises: The specific object stores the masked in a storage unit, Upon receiving an access request for the image stored in the storage unit, determine whether the source of the access request is permitted to access the image, The information processing apparatus according to (14), wherein when it is determined that access to the image is permitted, the mask is released.
- the processor comprises: The information processing apparatus according to (14) or (15), wherein the specific object is reversibly masked by the mask processing.
- the processor comprises: The information processing apparatus according to any one of (14) to (16), wherein the specific object is masked by encrypting a predetermined area including the specific object in the image in which the specific object is detected. .
- the processor comprises: Storing the received image in a storage unit, Upon receiving an access request for the image stored in the storage unit, determine whether the source of the access request is permitted to access the image, The information processing apparatus according to (14), wherein when it is determined that access to the image is not permitted, the specific object of the image is masked. (19)
- the processor comprises: The information processing apparatus according to (18), wherein the specific object is irreversibly masked by the mask processing. (20)
- the processor comprises: When detection information indicating that the specific object is detected is added to the image received by the communication unit, the specific object included in the image is masked (14) to (19). ).
- the processor comprises: When the detection information is added to the image received by the communication unit, obtains position information indicating the position of the specific object in the image, and masks the specific object based on the position information.
- the information processing device (20).
- the processor comprises: Masking the specific object included in the image based on position information indicating the position of the specific object on the image, which is added as the detection information to the image communicated by the communication unit; The information processing device according to (1).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Bioethics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Studio Devices (AREA)
Abstract
Description
図1は、各実施形態に適用可能な情報処理システムの一例の構成を概略的に示す図である。図1において、情報処理システム1は、ハードウェア構成としては、例えばインターネットであるネットワーク2により接続されるサーバ10と端末装置30とを含む。
(第1の実施形態に係る処理の概要)
次に、第1の実施形態に係る情報処理システムについて説明する。図2は、第1の実施形態に係る情報処理システム1による処理の流れを概略的に示す図である。ユーザ31は、端末装置30においてSNSアプリによりサーバ10にアクセスし、SNSにログインする。SNSにログイン後、ユーザ31は、端末装置30の撮像機能を用いて被写体の撮像を行う(ステップS1)。端末装置30において、SNSアプリは、撮像された撮像画像を解析し、撮像画像に含まれる特定のオブジェクトの検出を行う(ステップS2)。
次に、第1の実施形態に係る情報処理システム1のより詳細な構成について説明する。
次に、第1の実施形態に係る情報処理システム1における処理について、より詳細に説明する。図10は、第1の実施形態に係る端末装置30による、撮像画像のアップロード処理を示す一例のフローチャートである。なお、図10のフローによる処理の実行に先立って、端末装置30には、第1の実施形態に係る情報処理システム1が提供するサービス(例えばSNS)に対応するアプリケーションソフトウェア(SNSアプリ)が搭載されているものとする。また、端末装置30のユーザ31は、当該SNSにログインするためのアカウント情報を、サーバ10に対して予め登録しているものとする。
なお、上述では、端末装置30では撮像画像に対して少なくとも1の特定オブジェクトが含まれるか否かを検出し(図10、ステップS103)、サーバ10は、撮像画像に対して少なくとも1の特定オブジェクトが含まれている場合に、当該撮像画像を解析して特定オブジェクト領域を検出している(図13、ステップS207)。これはこの例に限定されず、端末装置30において、撮像画像から検出可能な全ての特定オブジェクトを検出するようにしてもよい。
次に、第2の実施形態について説明する。上述した第1の実施形態では、サーバ10は、可逆にマスク処理を施した撮像画像を登録し、正規アクセスに対して、撮像画像のマスクを解除していた。これに対して、第2の実施形態では、サーバ10は、撮像画像にマスク処理を施さずに登録を行い、不正アクセスによる撮像画像の取得要求に対して、当該撮像画像にマスク処理を施すようにしている。第2の実施形態では、マスク処理は、非可逆な方法を用いることができる。
次に、第3の実施形態について説明する。上述では、第1の実施形態および第2の実施形態をサーバ10による単独のサービスに対して適用した例について説明したが、これはこの例に限定されない。すなわち、本開示は、連携する複数のサービスについても適用可能である。
(1)
受光した光を画像に変換するイメージセンサと、
前記画像に対して特定のオブジェクトの検出を行う画像処理部と、
前記画像を出力する出力インタフェースと、
を含む固体撮像素子と、
前記出力インタフェースから出力される画像を送信する第1の通信部と、
を備える端末装置と、
第2の通信部と、
プロセッサと、
を備える情報処理装置と、
を有し、
前記プロセッサは、
前記端末装置から送信された画像を前記第2の通信部により受信し、
前記第2の通信部により受信された画像が前記画像処理部により前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクするマスク処理を行う
情報処理システム。
(2)
前記プロセッサは、
前記特定のオブジェクトがマスクされた前記画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていると判定した場合に、前記マスクを解除する
前記(1)に記載の情報処理システム。
(3)
前記プロセッサは、
前記マスク処理により前記特定のオブジェクトを可逆にマスクする
前記(1)または(2)に記載の情報処理システム。
(4)
前記プロセッサは、
前記特定のオブジェクトが検出された画像の、該特定のオブジェクトを含む所定領域を暗号化することで、該特定のオブジェクトをマスクする
前記(1)乃至(3)の何れかに記載の情報処理システム。
(5)
前記プロセッサは、
前記受信した画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていないと判定した場合に、該画像の前記特定のオブジェクトをマスクするマスク処理を行う
前記(1)に記載の情報処理システム。
(6)
前記プロセッサは、
前記マスク処理により前記特定のオブジェクトを非可逆にマスクする
前記(5)に記載の情報処理システム。
(7)
前記画像処理部は、
前記イメージセンサから出力された画像から前記特定のオブジェクトが検出された場合に、該画像に対して該特定のオブジェクトが検出された旨を示す検出情報を付加し、
前記第1の通信部は、
前記検出情報が付加された前記画像を送信し、
前記プロセッサは、
前記第2の通信部により受信された画像に前記検出情報が付加されている場合に、該画像に含まれる前記特定のオブジェクトをマスクする
前記(1)乃至(6)の何れかに記載の情報処理システム。
(8)
前記プロセッサは、
前記第2の通信部により受信された画像に前記検出情報が付加されている場合に、該画像における前記特定のオブジェクトの位置を示す位置情報を取得し、該位置情報に基づき該特定のオブジェクトをマスクする
前記(7)に記載の情報処理システム。
(9)
前記画像処理部は、
前記イメージセンサから出力される画像から前記特定のオブジェクトを検出し、検出された該特定のオブジェクトの該画像上での位置を示す位置情報を取得し、
前記第1の通信部は、
前記出力インタフェースから出力される画像に、前記位置情報を前記検出情報として付加して送信し、
前記プロセッサは、
前記第2の通信部により通信された画像に付加される前記位置情報に基づき、該画像に含まれる前記特定のオブジェクトをマスクする
前記(7)に記載の情報処理システム。
(10)
前記情報処理装置は、
協働して動作する複数の情報処理装置を含む
前記(1)乃至(9)の何れかに記載の情報処理システム。
(11)
端末装置が備える固定撮像素子が含むイメージセンサが、受光した光を画像に変換する変換ステップと、
前記固定撮像素子が含む画像処理部が前記画像に対して特定のオブジェクトの検出を行う検出ステップと、
前記固定撮像素子が含む出力インタフェースが前記画像を出力する出力ステップと、
前記端末装置が備える第1の通信部が前記出力ステップにより出力される画像を送信する送信ステップと、
情報処理装置が備えるプロセッサが、前記端末装置から送信された画像を第2の通信部により受信する受信ステップと、
前記プロセッサが、前記受信ステップにより受信された画像が前記検出ステップにより前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクする処理ステップと、
を有する情報処理方法。
(12)
受光した光を画像に変換するイメージセンサと、
前記画像から特定のオブジェクトを検出する画像処理部と、
前記画像を出力する出力インタフェースと、
を含む固体撮像素子と、
前記出力インタフェースから出力される画像を送信する通信部と、
を備え、
前記画像処理部は、
前記画像から前記特定のオブジェクトが検出された場合に、該画像に対して該特定のオブジェクトが検出された旨を示す検出情報を付加し、
前記通信部は、
前記検出情報が付加された前記画像を送信する
端末装置。
(13)
前記画像処理部は、
前記イメージセンサから出力される画像から前記特定のオブジェクトを検出し、検出された該特定のオブジェクトの該画像上での位置を示す位置情報を取得し、
前記通信部は、
前記出力インタフェースから出力される画像に、前記位置情報を前記検出情報として付加して送信する
前記(12)に記載の端末装置。
(14)
プロセッサと、
イメージセンサにより受光した光が変換された画像に対して特定のオブジェクトの検出を行い、該画像を送信する端末装置と通信を行う通信部と、
を備え、
前記プロセッサは、
前記端末装置から送信された前記画像を前記通信部により受信し、
前記通信部により受信された前記画像が前記端末装置により前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクするマスク処理を行う
情報処理装置。
(15)
前記プロセッサは、
前記特定のオブジェクトが前記マスクされた前記を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていると判定した場合に、前記マスクを解除する
前記(14)に記載の情報処理装置。
(16)
前記プロセッサは、
前記マスク処理により前記特定のオブジェクトを可逆にマスクする
前記(14)または(15)に記載の情報処理装置。
(17)
前記プロセッサは、
前記特定のオブジェクトが検出された画像の、該特定のオブジェクトを含む所定領域を暗号化することで、該特定のオブジェクトをマスクする
前記(14)乃至(16)の何れかに記載の情報処理装置。
(18)
前記プロセッサは、
前記受信した画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていないと判定した場合に、該画像の前記特定のオブジェクトをマスクする
前記(14)に記載の情報処理装置。
(19)
前記プロセッサは、
前記マスク処理により前記特定のオブジェクトを非可逆にマスクする
前記(18)に記載の情報処理装置。
(20)
前記プロセッサは、
前記通信部により受信された画像に、前記特定のオブジェクトが検出された旨を示す検出情報が付加されている場合に、該画像に含まれる前記特定のオブジェクトをマスクする
前記(14)乃至(19)の何れかに記載の情報処理装置。
(21)
前記プロセッサは、
前記通信部により受信された画像に前記検出情報が付加されている場合に、該画像における前記特定のオブジェクトの位置を示す位置情報を取得し、該位置情報に基づき該特定のオブジェクトをマスクする
前記(20)に記載の情報処理装置。
(22)
前記プロセッサは、
前記通信部により通信された画像に前記検出情報として付加される、前記特定のオブジェクトの該画像上での位置を示す位置情報に基づき、該画像に含まれる前記特定のオブジェクトをマスクする
前記(20)に記載の情報処理装置。
2 ネットワーク
10,11 サーバ
30,40,41 端末装置
50a,50a’,50b,50b’ 撮像画像
51a,51b,52a,52b 矩形領域
100 通信部
101 認証部
102 デコード部
103 解析部
104 マスク処理部
105 記憶部
300 撮像処理部
301 オブジェクト検出部
302 アプリケーション部
303 通信部
320 エンコード部
322 認証要求部
3003 撮像部
3100 画素部
3101 信号処理部
3102 メモリ部
3103 I/F部
3104 画像処理部
3105 素子制御部
Claims (18)
- 受光した光を画像に変換するイメージセンサと、
前記画像に対して特定のオブジェクトの検出を行う画像処理部と、
前記画像を出力する出力インタフェースと、
を含む固体撮像素子と、
前記出力インタフェースから出力される画像を送信する第1の通信部と、
を備える端末装置と、
第2の通信部と、
プロセッサと、
を備える情報処理装置と、
を有し、
前記プロセッサは、
前記端末装置から送信された画像を前記第2の通信部により受信し、
前記第2の通信部により受信された画像が前記画像処理部により前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクするマスク処理を行う
情報処理システム。 - 前記プロセッサは、
前記特定のオブジェクトがマスクされた前記画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていると判定した場合に、前記マスクを解除する
請求項1に記載の情報処理システム。 - 前記プロセッサは、
前記特定のオブジェクトが検出された画像の、該特定のオブジェクトを含む所定領域を暗号化することで、該特定のオブジェクトをマスクする
請求項1に記載の情報処理システム。 - 前記プロセッサは、
前記受信した画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていないと判定した場合に、該画像の前記特定のオブジェクトをマスクするマスク処理を行う
請求項1に記載の情報処理システム。 - 前記画像処理部は、
前記イメージセンサから出力された画像から前記特定のオブジェクトが検出された場合に、該画像に対して該特定のオブジェクトが検出された旨を示す検出情報を付加し、
前記第1の通信部は、
前記検出情報が付加された前記画像を送信し、
前記プロセッサは、
前記第2の通信部により受信された画像に前記検出情報が付加されている場合に、該画像に含まれる前記特定のオブジェクトをマスクする
請求項1に記載の情報処理システム。 - 前記プロセッサは、
前記第2の通信部により受信された画像に前記検出情報が付加されている場合に、該画像における前記特定のオブジェクトの位置を示す位置情報を取得し、該位置情報に基づき該特定のオブジェクトをマスクする
請求項5に記載の情報処理システム。 - 前記画像処理部は、
前記イメージセンサから出力される画像から前記特定のオブジェクトを検出し、検出された該特定のオブジェクトの該画像上での位置を示す位置情報を取得し、
前記第1の通信部は、
前記出力インタフェースから出力される画像に、前記位置情報を前記検出情報として付加して送信し、
前記プロセッサは、
前記第2の通信部により通信された画像に付加される前記位置情報に基づき、該画像に含まれる前記特定のオブジェクトをマスクする
請求項5に記載の情報処理システム。 - 前記情報処理装置は、
協働して動作する複数の情報処理装置を含む
請求項1に記載の情報処理システム。 - 端末装置が備える固定撮像素子が含むイメージセンサが、受光した光を画像に変換する変換ステップと、
前記固定撮像素子が含む画像処理部が前記画像に対して特定のオブジェクトの検出を行う検出ステップと、
前記固定撮像素子が含む出力インタフェースが前記画像を出力する出力ステップと、
前記端末装置が備える第1の通信部が前記出力ステップにより出力される画像を送信する送信ステップと、
情報処理装置が備えるプロセッサが、前記端末装置から送信された画像を第2の通信部により受信する受信ステップと、
前記プロセッサが、前記受信ステップにより受信された画像が前記検出ステップにより前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクする処理ステップと、
を有する情報処理方法。 - 受光した光を画像に変換するイメージセンサと、
前記画像から特定のオブジェクトを検出する画像処理部と、
前記画像を出力する出力インタフェースと、
を含む固体撮像素子と、
前記出力インタフェースから出力される画像を送信する通信部と、
を備え、
前記画像処理部は、
前記画像から前記特定のオブジェクトが検出された場合に、該画像に対して該特定のオブジェクトが検出された旨を示す検出情報を付加し、
前記通信部は、
前記検出情報が付加された前記画像を送信する
端末装置。 - 前記画像処理部は、
前記イメージセンサから出力される画像から前記特定のオブジェクトを検出し、検出された該特定のオブジェクトの該画像上での位置を示す位置情報を取得し、
前記通信部は、
前記出力インタフェースから出力される画像に、前記位置情報を前記検出情報として付加して送信する
請求項10に記載の端末装置。 - プロセッサと、
イメージセンサにより受光した光が変換された画像に対して特定のオブジェクトの検出を行い、該画像を送信する端末装置と通信を行う通信部と、
を備え、
前記プロセッサは、
前記端末装置から送信された前記画像を前記通信部により受信し、
前記通信部により受信された前記画像が前記端末装置により前記特定のオブジェクトが検出された画像である場合に、該特定のオブジェクトをマスクするマスク処理を行う
情報処理装置。 - 前記プロセッサは、
前記特定のオブジェクトが前記マスクされた画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていると判定した場合に、前記マスクを解除する
請求項12に記載の情報処理装置。 - 前記プロセッサは、
前記特定のオブジェクトが検出された画像の、該特定のオブジェクトを含む所定領域を暗号化することで、該特定のオブジェクトをマスクする
請求項12に記載の情報処理装置。 - 前記プロセッサは、
前記受信した画像を格納部に格納し、
前記格納部に格納された該画像に対するアクセス要求を受信した場合に、該アクセス要求の送信元が該画像にアクセスを許可されているか否かを判定し、
該画像に対するアクセスを許可されていないと判定した場合に、該画像の前記特定のオブジェクトをマスクする
請求項12に記載の情報処理装置。 - 前記プロセッサは、
前記通信部により受信された画像に、前記特定のオブジェクトが検出された旨を示す検出情報が付加されている場合に、該画像に含まれる前記特定のオブジェクトをマスクする
請求項12に記載の情報処理装置。 - 前記プロセッサは、
前記通信部により受信された画像に前記検出情報が付加されている場合に、該画像における前記特定のオブジェクトの位置を示す位置情報を取得し、該位置情報に基づき該特定のオブジェクトをマスクする
請求項16に記載の情報処理装置。 - 前記プロセッサは、
前記通信部により通信された画像に前記検出情報として付加される、前記特定のオブジェクトの該画像上での位置を示す位置情報に基づき、該画像に含まれる前記特定のオブジェクトをマスクする
請求項16に記載の情報処理装置。
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201980055080.1A CN112585605A (zh) | 2018-09-06 | 2019-08-09 | 信息处理系统、信息处理方法、终端装置和信息处理装置 |
| EP19856653.1A EP3848839A4 (en) | 2018-09-06 | 2019-08-09 | INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING PROCESS, TERMINAL DEVICE, AND INFORMATION PROCESSING DEVICE |
| JP2020541092A JP7585788B2 (ja) | 2018-09-06 | 2019-08-09 | 情報処理システム、情報処理方法および情報処理装置 |
| US17/268,039 US12135807B2 (en) | 2018-09-06 | 2019-08-09 | Information processing system, information processing method, terminal apparatus, and information processing apparatus |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2018167374 | 2018-09-06 | ||
| JP2018-167374 | 2018-09-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020049958A1 true WO2020049958A1 (ja) | 2020-03-12 |
Family
ID=69722526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2019/031661 Ceased WO2020049958A1 (ja) | 2018-09-06 | 2019-08-09 | 情報処理システム、情報処理方法、端末装置および情報処理装置 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12135807B2 (ja) |
| EP (1) | EP3848839A4 (ja) |
| JP (1) | JP7585788B2 (ja) |
| CN (1) | CN112585605A (ja) |
| WO (1) | WO2020049958A1 (ja) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2023063948A (ja) * | 2021-10-25 | 2023-05-10 | キヤノン株式会社 | 画像処理装置、制御方法及びプログラム |
| JP2023536383A (ja) * | 2020-06-10 | 2023-08-25 | 北京沃▲東▼天▲駿▼信息技▲術▼有限公司 | プライバシーを保護するための方法、デバイス、およびシステム |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6638852B1 (ja) | 2018-08-31 | 2020-01-29 | ソニー株式会社 | 撮像装置、撮像システム、撮像方法および撮像プログラム |
| KR102544626B1 (ko) * | 2019-01-23 | 2023-06-19 | 한국전자통신연구원 | 마스킹 영역 처리 시스템 및 방법 |
| KR102454677B1 (ko) * | 2021-01-25 | 2022-10-17 | 주식회사 노타 | 암호 키 기반 영상의 개인정보 비 식별화 및 복원 기술 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006319775A (ja) * | 2005-05-13 | 2006-11-24 | Matsushita Electric Ind Co Ltd | 映像配信システム |
| JP2009033738A (ja) * | 2007-07-04 | 2009-02-12 | Sanyo Electric Co Ltd | 撮像装置、画像ファイルのデータ構造 |
| JP2009194687A (ja) | 2008-02-15 | 2009-08-27 | Sony Corp | 画像処理装置、カメラ装置、通信システム、画像処理方法、およびプログラム |
| JP2015184909A (ja) * | 2014-03-24 | 2015-10-22 | キヤノン株式会社 | 画像処理システム、データ管理方法及びプログラム |
| JP2017184120A (ja) * | 2016-03-31 | 2017-10-05 | 株式会社Medi Plus | 画像処理システム |
| US20180189461A1 (en) * | 2016-12-31 | 2018-07-05 | Entefy Inc. | System and method of applying multiple adaptive privacy control layers to encoded media file types |
| JP2019050553A (ja) * | 2017-09-07 | 2019-03-28 | キヤノン株式会社 | 画像処理装置、画像提供装置、それらの制御方法及びプログラム |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001222719A (ja) | 1999-12-01 | 2001-08-17 | Matsushita Electric Ind Co Ltd | 顔抽出装置及び顔抽出方法並びに顔抽出プログラムの記録媒体 |
| JP4698261B2 (ja) * | 2005-03-25 | 2011-06-08 | Necフィールディング株式会社 | 暗号通信システムと方法、及びプログラム |
| US9270841B2 (en) * | 2005-04-15 | 2016-02-23 | Freeze Frame, Llc | Interactive image capture, marketing and distribution |
| JP2006319668A (ja) * | 2005-05-12 | 2006-11-24 | Sharp Corp | 情報処理装置、ユーザ端末および画像処理システム |
| JP4671133B2 (ja) * | 2007-02-09 | 2011-04-13 | 富士フイルム株式会社 | 画像処理装置 |
| US8233677B2 (en) | 2007-07-04 | 2012-07-31 | Sanyo Electric Co., Ltd. | Image sensing apparatus and image file data structure |
| JP2012244416A (ja) * | 2011-05-19 | 2012-12-10 | Canon Inc | システム、暗号処理装置 |
| US20140229544A1 (en) * | 2013-02-12 | 2014-08-14 | BackPeddle, LLC | Sharing content in social networks |
| JP2016167170A (ja) | 2015-03-10 | 2016-09-15 | キヤノン株式会社 | 顔情報の公開範囲に関連したシステム |
| JP6726052B2 (ja) | 2015-11-20 | 2020-07-22 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | 画像処理方法およびプログラム |
| US10467387B2 (en) * | 2016-06-23 | 2019-11-05 | Oath Inc. | Computerized system and method for modifying a media file by automatically applying security features to select portions of media file content |
| WO2018060863A1 (en) * | 2016-09-27 | 2018-04-05 | Parikh Varsha | Method and device for covering private data |
| US10160034B2 (en) | 2017-01-30 | 2018-12-25 | National Machinery Llc | Sideways forming |
| KR101859433B1 (ko) * | 2017-02-14 | 2018-05-21 | 에스케이텔레콤 주식회사 | 영상 모자이크 처리 방법 및 이를 위한 장치 |
| EP3454254B1 (en) | 2017-09-07 | 2023-11-08 | Canon Kabushiki Kaisha | Image processing apparatus, image providing apparatus, control methods thereof, and program |
| US10931836B2 (en) * | 2018-03-29 | 2021-02-23 | Ricoh Company, Ltd. | Communication system, image processing method, and recording medium |
-
2019
- 2019-08-09 EP EP19856653.1A patent/EP3848839A4/en not_active Withdrawn
- 2019-08-09 CN CN201980055080.1A patent/CN112585605A/zh active Pending
- 2019-08-09 WO PCT/JP2019/031661 patent/WO2020049958A1/ja not_active Ceased
- 2019-08-09 US US17/268,039 patent/US12135807B2/en active Active
- 2019-08-09 JP JP2020541092A patent/JP7585788B2/ja active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006319775A (ja) * | 2005-05-13 | 2006-11-24 | Matsushita Electric Ind Co Ltd | 映像配信システム |
| JP2009033738A (ja) * | 2007-07-04 | 2009-02-12 | Sanyo Electric Co Ltd | 撮像装置、画像ファイルのデータ構造 |
| JP2009194687A (ja) | 2008-02-15 | 2009-08-27 | Sony Corp | 画像処理装置、カメラ装置、通信システム、画像処理方法、およびプログラム |
| JP2015184909A (ja) * | 2014-03-24 | 2015-10-22 | キヤノン株式会社 | 画像処理システム、データ管理方法及びプログラム |
| JP2017184120A (ja) * | 2016-03-31 | 2017-10-05 | 株式会社Medi Plus | 画像処理システム |
| US20180189461A1 (en) * | 2016-12-31 | 2018-07-05 | Entefy Inc. | System and method of applying multiple adaptive privacy control layers to encoded media file types |
| JP2019050553A (ja) * | 2017-09-07 | 2019-03-28 | キヤノン株式会社 | 画像処理装置、画像提供装置、それらの制御方法及びプログラム |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3848839A4 |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2023536383A (ja) * | 2020-06-10 | 2023-08-25 | 北京沃▲東▼天▲駿▼信息技▲術▼有限公司 | プライバシーを保護するための方法、デバイス、およびシステム |
| JP7553601B2 (ja) | 2020-06-10 | 2024-09-18 | 北京沃▲東▼天▲駿▼信息技▲術▼有限公司 | プライバシーを保護するための方法、デバイス、およびシステム |
| US12353593B2 (en) | 2020-06-10 | 2025-07-08 | Beijing Wodong Tianjun Information Technology Co., Ltd. | Method, device and system for protecting privacy |
| JP2023063948A (ja) * | 2021-10-25 | 2023-05-10 | キヤノン株式会社 | 画像処理装置、制御方法及びプログラム |
| JP7799430B2 (ja) | 2021-10-25 | 2026-01-15 | キヤノン株式会社 | 画像処理装置、制御方法及びプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| US12135807B2 (en) | 2024-11-05 |
| JPWO2020049958A1 (ja) | 2021-08-12 |
| CN112585605A (zh) | 2021-03-30 |
| US20210319144A1 (en) | 2021-10-14 |
| EP3848839A1 (en) | 2021-07-14 |
| JP7585788B2 (ja) | 2024-11-19 |
| EP3848839A4 (en) | 2021-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7585788B2 (ja) | 情報処理システム、情報処理方法および情報処理装置 | |
| KR102090696B1 (ko) | 영상수신장치, 영상수신장치의 영상 복원 방법, 및 영상 시스템의 영상 마스킹 및 복원 방법 | |
| CN113727035A (zh) | 图像处理方法、系统、电子设备及存储介质 | |
| US11356580B1 (en) | Method for preventing screen capture | |
| CN114270776B (zh) | 成像设备、图像数据处理方法以及程序 | |
| US11265475B2 (en) | Image capturing apparatus, client apparatus, method for controlling image capturing apparatus, method for controlling client apparatus, and non-transitory computer-readable storage medium | |
| US9451128B2 (en) | Mobile data processing having secured association with multifunction device | |
| CN115484086B (zh) | 云手机屏幕共享方法及电子设备、计算机可读存储介质 | |
| JP6211125B2 (ja) | 画像処理システム | |
| JP7501369B2 (ja) | 撮像素子、撮像装置および方法 | |
| JP2000059771A (ja) | 画像撮像装置および画像データ利用システム | |
| WO2018090685A1 (zh) | 图像数据加密方法及装置、网络摄像机 | |
| CN115996123A (zh) | 摄像设备、管理系统、控制方法和存储介质 | |
| CN117917086A (zh) | 检查设备的位置 | |
| KR20220117166A (ko) | 네트워크에 이미지 캡쳐링 디바이스를 설치하기 위한 방법 및 이미지 캡쳐링 디바이스 | |
| CN116158072A (zh) | 图像处理电路和图像处理方法 | |
| US20250373783A1 (en) | Video transmission apparatus, video reception apparatus, video transmission method, video reception method, and storage medium | |
| US20250373443A1 (en) | Video transmission apparatus, video reception apparatus, video transmission method, video reception method, and storage medium | |
| EP4657847A1 (en) | Video transmission apparatus, video reception apparatus, video system, video transmission method, video reception method, and program | |
| JP7739144B2 (ja) | 撮像制御装置及びコンピュータプログラム | |
| US20240104232A1 (en) | Information processing apparatus, control method thereof, storage medium, and information processing system | |
| WO2025196872A1 (ja) | 映像管理装置、映像管理システム、方法およびプログラム | |
| CN120070280A (zh) | 数据处理方法、装置、设备、介质以及产品 | |
| CN120070228A (zh) | 一种视频会议画面识别打码方案、系统及计算机设备 | |
| WO2016195060A1 (ja) | 画像処理システム、サーバ装置、サーバ装置の制御方法、及びプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19856653 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2020541092 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019856653 Country of ref document: EP Effective date: 20210406 |
|
| WWW | Wipo information: withdrawn in national office |
Ref document number: 2019856653 Country of ref document: EP |