WO2017131265A1 - Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants - Google Patents

Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants Download PDF

Info

Publication number
WO2017131265A1
WO2017131265A1 PCT/KR2016/001032 KR2016001032W WO2017131265A1 WO 2017131265 A1 WO2017131265 A1 WO 2017131265A1 KR 2016001032 W KR2016001032 W KR 2016001032W WO 2017131265 A1 WO2017131265 A1 WO 2017131265A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
analysis
data
server
image analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2016/001032
Other languages
English (en)
Korean (ko)
Inventor
최혜승
이정현
김경숙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
KNOWLEDGE SOCIETY INTEGRATION CO Ltd
Original Assignee
KNOWLEDGE SOCIETY INTEGRATION CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by KNOWLEDGE SOCIETY INTEGRATION CO Ltd filed Critical KNOWLEDGE SOCIETY INTEGRATION CO Ltd
Priority to PCT/KR2016/001032 priority Critical patent/WO2017131265A1/fr
Publication of WO2017131265A1 publication Critical patent/WO2017131265A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/22—Status alarms responsive to presence or absence of persons
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to an image analysis system for image analysis of multi-objects and the provision of the results. More particularly, the present invention relates to analyzing a plurality of objects of interest in accordance with a user's needs in a plurality of images obtained through multiple channels in various devices.
  • An image analysis system capable of providing analysis result data.
  • the present invention is intended to derive more and useful information than a simple form of information used from many images that can be collected from a number of CCTV or mobile devices, and to provide faster and more interrelationships among the various elements of the system.
  • the purpose of the present invention is to provide an image analysis system for securing image data of multiple objects and providing results thereof.
  • An object of the present invention is to provide an image analysis system for multi-object image analysis and the results provided that the user's needs can be quickly and flexibly reflected in order to increase the usefulness in image analysis.
  • a plurality of terminal devices installed on each user side having authority to at least some of the image collecting devices;
  • a VMS server for acquiring image data from a plurality of image acquisition devices through a network and standardizing it to enable a consistent analysis process
  • the standardized image data is received from the VMS server, classified according to a set condition, assigned to a plurality of patterned image processing analysis modules therein, and the analysis result data of the image processing analysis module is received.
  • Image analysis server that can store in the database server and provide the analysis result data to the terminal device of the user side,
  • the user terminal Among the analysis result data between the image analysis server and the user, the user terminal provides the data corresponding to the predetermined condition related to the user terminal device and has the image analysis pattern or the image analysis pattern suitable for the image data upon receiving the setting request of the user terminal device. And a setting and matching function unit (setting and matching SDK) configured to control at least a part of an operation of the image analysis server so as to select an image processing analysis module.
  • a setting and matching function unit (setting and matching SDK) configured to control at least a part of an operation of the image analysis server so as to select an image processing analysis module.
  • the image analysis server has a plurality of individual image analysis server which is installed in parallel to be assigned to the video data by operating in accordance with the amount of video data or the number of paths, wherein each individual video analysis server is a plurality of different image analysis
  • the processing module may be connected to exchange image data and analysis result data.
  • some of the plurality of different image analysis processing module may be an image analysis processing module having different image analysis patterns (algorithms, programs), and a plurality of image analysis processing modules having the same type of image analysis pattern are included. It may be.
  • the setting and matching function unit may be made to receive the image data from the VMS server and to match the analysis result data associated with the image data to transmit to the user terminal device.
  • a plurality of individual video analysis servers can be used to allocate the video data according to the amount of information, and the related video data can be assigned to the same individual video analysis server and analyzed, and the images to be processed by the same processing method.
  • Data can be assigned to a patterned image processing analysis module with appropriate processing algorithms, but it can be processed by categorizing the processing algorithms into several typical types and equipping them with image processing analysis modules to handle them.
  • it is possible to analyze a plurality of objects together from many images that can be collected in a mobile device, and it is advantageous to derive more and useful information than a simple form of information used in the past.
  • the present invention it is possible to secure a rapid and mutual correlation between a plurality of elements constituting the system, and to enable automatic image data analysis, which is advantageous for deriving a desired form of result data from multi-object analysis.
  • the present invention it is possible to flexibly reflect the user's analysis request immediately using the SDK for setting and matching, so that it is possible to derive and utilize image analysis result data in a form more suitable for the user.
  • FIG. 1 is a schematic view showing the configuration of a video analysis server as a part of an embodiment of the system of the present invention
  • FIG. 2 is a conceptual diagram showing an embodiment of the system of the present invention
  • Figure 3 is a display screen that can be displayed on the display of the user terminal device in accordance with an embodiment of the system of the present invention.
  • system of the present invention will be described based on image analysis and provision of analyzed result data rather than displaying and implementing various formats of existing real-time image images.
  • the image data is collected by the image collecting apparatus 10 for collecting image data, such as a closed circuit TV (CCTV), and the image data is transmitted to the video management system (VMS) server 20 through a network.
  • CCTV closed circuit TV
  • VMS video management system
  • Each CCTV has a different manufacturer and may have different data processing patterns or processing rules. Since a path for sending data to the VMS server 20 from an image data collecting device such as CCTV can be considered as a fixed channel, the collecting device and the channel may not be the same but may be used in the following meanings.
  • the VMS server 20 has a compatible device capable of converting various types of images received therein into one standardized form, which includes a DLL file and a processor for image processing of each form. Can be done. Most IP cameras or video encoders on the market today support RTSP and ONVIF, so they can be used as a standardizing tool.
  • the VMS server 20 standardizes the images flowing in real time through each network channel, compresses them in order to reduce the amount of data, indexes the data by channel (device) and time zone where basic video data is transmitted, and divides them into packet types. And, it can be stored through a separate database server not shown, on the other hand can be provided in real time to the user terminal device 50 associated with the image data collection channel.
  • the VMS server 20 provides the image data made in the form of a packet to the image analysis server 30.
  • the video analysis server 30 may take the form of a single server when a device connected to a system such as a CCTV for transmitting raw video data or a small number of connection channels for sending raw video data, but the number of connected devices and received data increases.
  • a plurality of individual image analysis servers 30a installed as shown in FIG. 1 may be provided.
  • each of the individual image analysis servers 30a includes a VMS interworking module 32, an image processing analysis module 35, a viewer controller 34, and a channel coordinator 36.
  • the VMS interworking module 32 receives the standardized and compressed packet data sent from the VMS server 20 and decompresses and delivers the data to the viewer controller 34.
  • the viewer controller 34 transmits the video. Takes the data and takes into account the information associated with the image data and the setting conditions of the image analysis server 30 to allocate to the image processing analysis module 35.
  • the individual image analysis server 30a has one image processing analysis module 35, but the image processing analysis module 35 has a specialized analysis algorithm (program, pattern) as shown in FIG. 2.
  • a plurality of patterned image processing analysis module having a) may be installed in parallel.
  • each image processing analysis module 35 appears to be dedicated in the individual image analysis server 30a, a plurality of individual image analysis servers 30a and a plurality of image processing analysis modules 35 are included in the entire image analysis server 30.
  • each individual image analysis server 30a is connected to a plurality of image processing analysis module 35 so that each individual image analysis server 30a can be connected to the image processing analysis module 35 of the required pattern whenever necessary.
  • the amount of analysis is large, it may be connected to two or more image processing analysis module (35).
  • the individual image analysis server 30a may be connected in various forms, and the image processing analysis module 35 may be jointly used.
  • Each image processing analysis module 35 may have its own image analysis algorithm, and different image processing analysis modules 35 may have the same or different algorithms.
  • module A is to analyze the face shape of the person who is the object and provide the result data
  • module B is to analyze the clothing form and provide the result data
  • module C is to recognize and analyze the license plate of the object as the object It may be to provide data.
  • the same image data can be sent to more than one image processing module for image analysis.
  • the same image data may be sent to the A and B modules.
  • the analysis result data processed by the image processing analysis module has a common form of metadata, and the metadata also has basic information on the device or channel and time (time zone) provided with the original image data, and is classified based on these. It may be written as.
  • the analysis result data may be transmitted to the viewer controller 34 again and transferred to the database server 40 and stored.
  • geographical information such as the manufacturer, model, resolution, transmission method, address or latitude and longitude of the device is associated with its own number or name, and the VMS server 20 and the video analysis server are related information.
  • 30 may be provided in advance in the database server 30 and stored, and if necessary, it may be provided to a user in association with the analysis result data for the image, or may be used to create secondary processing data in a database in the form of secondary processing data. It may be stored in the server 40 and provided to the user.
  • the analysis result data image provided to the user in the viewer controller 34 is managed through the channel coordinator 36.
  • the channel coordinator 36 determines which user terminal device 50 the analysis result data sent to the viewer controller 34 should be sent to and provides the user terminal device 50.
  • the entire video analysis server 30 is in addition to the individual video analysis server.
  • a management server (not shown) and a dedicated monitor (FIG. 1 50) may be installed, the current allocation state may be checked on the dedicated monitor, and abnormality may be checked.
  • the above-described channel coordinator 36 may send these analysis result data images to this dedicated monitor or other dedicated monitor installed in the image analysis server 30 to manage the screen sent to each user terminal device 50.
  • the management server may be set to screen the analysis result data image sent by the channel coordinator of each individual image analysis server as necessary to check on a dedicated monitor.
  • the image analysis server 30 provides the analysis result data to a plurality of user-side terminal devices 50 such that the image collecting device 10 transmits raw image data to the VMS server 20.
  • a network such as may be used.
  • the video analysis server 30 and the plurality of user terminal devices 50 may be interconnected through the SDK 33 for setting and matching.
  • the setting and matching SDK 33 includes a server side program and a user side program, and the user side program may be provided to the user side by the system operator through online or offline.
  • the user side can be connected to the server side and network through the authentication process such as ID and password input by activating the program in the terminal device.
  • the setting and matching SDK 33 not only connects the image analysis server 30 and the user terminal device 50, but also sets and changes various conditions within a certain limit provided by the system operation subject. It is possible to use the analysis result data of the image to suit their purpose. That is, it is possible to change the analysis work of the image analysis server by setting or changing the settings in the program.
  • the setting and matching SDK 33 may be determined as a separate element that is not part of the image analysis server 30, but for convenience, the setting of the matching and matching function is referred to as a part of the image analysis server 30. It may be regarded as a combination of software in the form of an SDK 33 and a processor in a server.
  • the setting and matching SDK 33 has a bundle of DLL programs that can be written differently according to a user.
  • Each DLL program uses the settings and modifications input from the user terminal device 50 to determine the condition of the image analysis and the accessible data range (determining which range the channel coordinator will provide to which user terminal device up to the analysis result data).
  • the condition may be a basis and a criterion for the image analysis server to allocate an image of a specific channel to a patterned image processing analysis module having a specific algorithm.
  • each image processing analysis module is provided to the image analysis server with an algorithm (analysis program) corresponding thereto according to the set condition to analyze the image data assigned to the corresponding image processing analysis module 35.
  • an algorithm analysis program
  • the management server assigns them all to a specific individual video analysis server, and the viewer controller of the individual video analysis server allocates these data to module C, an image processing analysis module having a license plate recognition function.
  • Module C designates all the vehicles in each parking zone in the image as objects of interest and recognizes the vehicle number in each license plate.
  • the parking lot K which is a user, uses the setting and matching SDK to associate the image analysis result data with the time zone information of the image, and the vehicle number of the entire vehicle using each parking area in the image analysis server and the time zone when the vehicle is first caught by CCTV.
  • the image, the time zone when the vehicle starts parking, the parking time after leaving the parking area, and the image are requested as analysis result data, and the image analysis processing module can provide the analysis result data.
  • the data analysis result of this image can be further processed by date in the form of a table of the vehicle number, parking start time, parking end time, parking time, parking fee using a certain fee, etc.
  • the spreadsheet file in the form of an Excel can be stored in a database server like the first image analysis result data and provided to an associated user terminal device.
  • this secondary processing or providing format is possible on the premise that the user requests the image analysis server using the setting and matching SDK, and the system supports the secondary processing and providing format.
  • the video analysis server 30 is connected to the network by the parking lot K terminal activates the user program through the terminal device and inputs the ID and password, and the terminal device sends a signal requesting the parking usage condition of the date through the function key. It delivers to the viewer controller 34 of the individual image analysis server 30a analyzing the CCTV image related to the K parking lot, and the viewer controller 34 transmits the database server through the image processing analysis module (module C) of the individual image analysis server.
  • the analysis result data for the image of the corresponding date stored in 40) may be extracted and provided in the form of an image on the display screen of the terminal device 50 of the K parking lot through the channel coordinator, or may be provided in the form of other files for checking.
  • the video data that standardizes the video data transmitted from the CCTVs is associated with the channel (or the device providing the video)
  • the time zone information is assigned to a specific individual video analysis server (30a), and all of the video data is assigned to the A module that recognizes and analyzes the face shape.
  • L management office can input specific photo by setting and matching SDK through terminal device.
  • a module receives face image of a given specific person, records and analyzes it, compares it, and analyzes image data for a certain period of time. For example, IDs are assigned to all recognizable people in the video data, face shape analysis is performed, and whether the face shape matches a given person's face is checked. By checking the video data (packets) in which a particular person appears, it can provide a CCTV and the time (time zone) at which the video was taken or the scene image.
  • the system can display the location on the map of the channel (or the corresponding CCTV) that transmits video data, as shown in FIG.
  • the spot found can be marked as a location on the map, and the video can be displayed along with the findings of that particular person.
  • the number of image collection devices constituting the system increases, and the image collection devices having various attributes are used and accumulated over a plurality of times.
  • such data can be treated as a kind of big data, and the reanalysis of the analysis result data can be easily performed using the SDK for setting and matching the present invention. It is possible to extract trends and information.
  • the system of the present invention can be a tool that can be usefully provided by providing such big data re-analysis and thereby business information and public information.
  • the analysis result data obtained from the image processing analysis module is combined with the data image, channel information related to the image, time zone information, and the like as a packet having a certain format as metadata and provided directly to the user through the VMS server.
  • the delayed analysis result data having a certain delay time for the analysis may be provided together in real time. This real-time analysis can be useful for disaster prevention and prevention, where real-time characteristics are important.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un système d'analyse d'images comprenant : une pluralité de dispositifs de collecte d'images; une pluralité de dispositifs terminaux placés sur chaque côté utilisateur ayant autorité sur les dispositifs de collecte d'images; un serveur VMS qui obtient des données d'images, de la pluralité de dispositifs de collecte d'images, via un réseau, et standardise les données d'images afin de permettre une opération d'analyse cohérente; un serveur d'analyse d'images qui reçoit les données d'images, du serveur VMS, classe les données d'images selon une condition prédéterminée, attribue les données d'images à une pluralité de modules d'analyse et de traitement d'images à motifs, reçoit des données de résultats d'analyse des modules d'analyse et de traitement d'images, stocke les données de résultats d'analyse dans un serveur de base de données (DB), et fournit les données de résultats d'analyse à un dispositif terminal sur un côté utilisateur ayant autorité; et une unité fonctionnelle de configuration et d'adaptation qui reçoit une transmission des données de résultats d'analyse entre le serveur d'analyse d'images et un utilisateur et une demande de configuration du dispositif terminal sur le côté utilisateur de sorte à commander au moins une partie du fonctionnement du serveur d'analyse d'image. La présente invention peut dériver plus d'informations que le formulaire simple existant, et peut refléter des demandes d'analyse sur un côté utilisateur avec une plus grande flexibilité via l'analyse conjointe d'une pluralité d'objets à partir d'un grand nombre d'images pouvant être collectées à une pluralité de CCTV ou de dispositifs mobiles.
PCT/KR2016/001032 2016-01-29 2016-01-29 Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants Ceased WO2017131265A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2016/001032 WO2017131265A1 (fr) 2016-01-29 2016-01-29 Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2016/001032 WO2017131265A1 (fr) 2016-01-29 2016-01-29 Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants

Publications (1)

Publication Number Publication Date
WO2017131265A1 true WO2017131265A1 (fr) 2017-08-03

Family

ID=59398448

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/001032 Ceased WO2017131265A1 (fr) 2016-01-29 2016-01-29 Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants

Country Status (1)

Country Link
WO (1) WO2017131265A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112732248A (zh) * 2020-12-30 2021-04-30 武汉木仓信息技术有限公司 一种模块化软件开发方法、装置、电子设备及存储介质
EP3843384A1 (fr) * 2019-12-23 2021-06-30 Yokogawa Electric Corporation Serveur de distribution, procédé et programme

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010245578A (ja) * 2009-04-01 2010-10-28 Hitachi Kokusai Electric Inc 映像監視システム
KR20140021097A (ko) * 2012-08-07 2014-02-20 에스케이씨앤씨 주식회사 분산처리 기반 카메라 영상 서비스 시스템 및 방법
KR20150034398A (ko) * 2013-09-26 2015-04-03 서진이엔에스(주) 객체인식 기반의 주차장 이벤트 검지 시스템
KR101534532B1 (ko) * 2014-12-01 2015-07-07 (주) 조은세이프 비디오 기록 장치를 포함하는 비디오 관제 시스템 및 비디오 기록 장치로부터 수신된 요청에 따른 상태 처리 방법
KR101556076B1 (ko) * 2015-02-17 2015-09-30 케이에스아이 주식회사 주차 통합 관리 시스템 및 이를 이용한 주차 관리 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010245578A (ja) * 2009-04-01 2010-10-28 Hitachi Kokusai Electric Inc 映像監視システム
KR20140021097A (ko) * 2012-08-07 2014-02-20 에스케이씨앤씨 주식회사 분산처리 기반 카메라 영상 서비스 시스템 및 방법
KR20150034398A (ko) * 2013-09-26 2015-04-03 서진이엔에스(주) 객체인식 기반의 주차장 이벤트 검지 시스템
KR101534532B1 (ko) * 2014-12-01 2015-07-07 (주) 조은세이프 비디오 기록 장치를 포함하는 비디오 관제 시스템 및 비디오 기록 장치로부터 수신된 요청에 따른 상태 처리 방법
KR101556076B1 (ko) * 2015-02-17 2015-09-30 케이에스아이 주식회사 주차 통합 관리 시스템 및 이를 이용한 주차 관리 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3843384A1 (fr) * 2019-12-23 2021-06-30 Yokogawa Electric Corporation Serveur de distribution, procédé et programme
EP4203465A1 (fr) 2019-12-23 2023-06-28 Yokogawa Electric Corporation Serveur, procédé et programme de distribution
CN112732248A (zh) * 2020-12-30 2021-04-30 武汉木仓信息技术有限公司 一种模块化软件开发方法、装置、电子设备及存储介质

Similar Documents

Publication Publication Date Title
KR101782339B1 (ko) 다중객체 영상분석 및 그 결과 제공을 위한 영상분석 시스템
WO2012077944A2 (fr) Système d'identification de terminaux partagés utilisant un paquet de réseau et son procédé de traitement
KR102024149B1 (ko) 지능형 스마트 선별 관제 시스템
GB2577689A (en) Video surveillance and object recognition
CN102073849A (zh) 目标图像识别系统及方法
CN104200671A (zh) 一种基于大数据平台的虚拟卡口管理方法及系统
KR101612483B1 (ko) 실시간으로 카메라 영상을 분석하는 저장/분배 서버, 이를 포함하는 통합 관제 시스템 및 그 동작방법
CN110798653B (zh) 一种基于多机协作的图像处理方法和视频监控系统
KR102297217B1 (ko) 영상들 간에 객체와 객체 위치의 동일성을 식별하기 위한 방법 및 장치
CN106303399A (zh) 车辆图像数据的采集、提供方法、设备、系统及服务器
CN105791747A (zh) 视频监控方法和装置
WO2016133234A1 (fr) Système d'analyse d'image pour analyser une image d'appareil photographique alloué de manière dynamique, système de commande intégré comprenant ce dernier, et procédé de fonctionnement associé
CN117998150A (zh) 一种监控视频数据的获取方法、装置、设备及存储介质
CN112948779B (zh) 基于前端获取的多级共享人像大数据系统
WO2017131265A1 (fr) Analyse d'images multi-objet, et système d'analyse d'images pour fournir des résultats correspondants
KR102420151B1 (ko) 집합적 인지 추적 기반의 모바일 온디맨드 cctv 시스템
KR100885734B1 (ko) 영상정보 처리 시스템 및 방법
WO2025127850A1 (fr) Plateforme d'analyse d'image intelligente basée sur un apprentissage de données automatique pour chaque situation
WO2021107209A1 (fr) Dispositif de service de surveillance intelligent et son procédé de fonctionnement
CN109120896B (zh) 安防视频监控卫士系统
WO2018067058A1 (fr) Procédé de partage d'informations dans un système de capteurs d'imagerie
KR102716707B1 (ko) 분산 협업 기반 시스템 및 이의 영상 스트림 실시간 분석 방법
CN112039908B (zh) 前端设备的监控方法及装置、存储介质、电子装置
CN211044247U (zh) 一种宾馆酒店用视频监测系统
WO2022017192A1 (fr) Dispositif de calcul en périphérie, et procédé et système de calcul en périphérie

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16888241

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16888241

Country of ref document: EP

Kind code of ref document: A1