WO2019103221A1 - Système et procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt - Google Patents

Système et procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt Download PDF

Info

Publication number
WO2019103221A1
WO2019103221A1 PCT/KR2017/013825 KR2017013825W WO2019103221A1 WO 2019103221 A1 WO2019103221 A1 WO 2019103221A1 KR 2017013825 W KR2017013825 W KR 2017013825W WO 2019103221 A1 WO2019103221 A1 WO 2019103221A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
image
interest
roi
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2017/013825
Other languages
English (en)
Korean (ko)
Inventor
윤희돈
강호갑
김태현
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DRM INSIDE Co Ltd
Original Assignee
DRM INSIDE Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DRM INSIDE Co Ltd filed Critical DRM INSIDE Co Ltd
Priority to JP2018541398A priority Critical patent/JP6648289B2/ja
Publication of WO2019103221A1 publication Critical patent/WO2019103221A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/10—Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
    • G06F21/16—Program or content traceability, e.g. by watermarking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/10—Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/40—Image enhancement or restoration using histogram techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features

Definitions

  • the present invention relates to a system and method for identifying an on-line cartoon based on a region of interest, and more particularly, to a system and method for identifying a region of interest on an on- And an online cartoon identification system based on the extracted region of interest and an on-line cartoon identification system based on the region of interest and a method thereof.
  • online cartoon-related contents such as web toon are one of the most popular contents, and the most illegal copy contents are present. Therefore, in order to prevent pirated contents related to such online cartoon Techniques for identifying and preventing pirated content by applying various technologies are emerging.
  • the server for publishing the online comic contents on the web site divides the original image constituting the on-line comic contents into a plurality of images and manages them, a specific scene is divided into a plurality of images In this case, even if the minutiae are extracted for a specific scene divided into a plurality of images constituting the original image, the minutiae are extracted from the single original image and a comparison with the illegally copied image is performed A difficult problem arises.
  • the specific scene may be defined as a single cut, a single frame, a single panel, or a single frame.
  • scenes (or cuts) of the original image are cut out in the same manner as capturing and used for various purposes such as the emoticon use of the dialogue window and the prevention of the squeezing of the cutout image.
  • a user who shows an interest in a scene image uses a search tool based on various image search to search for contents including the scene image.
  • such a scene image may also be produced in various sizes, so that the feature points are compared with the original image Detection is not easy.
  • the present invention identifies a region of interest composed of one meaningful scene (or cut) in an image, extracts and normalizes the region of interest, and then extracts feature points through HOG-based image analysis, By supporting the feature points to be compared according to the interest areas of the original images constituting the content, it is possible to greatly reduce the amount of computation compared to the existing feature point extraction method, thereby improving the processing speed for the content identification corresponding to the identification target image, And to increase the accuracy of identification of the content associated with the identification target image produced in various sizes.
  • the interest area-based on-line cartoon identification system includes an interest area extraction unit that extracts a region of interest through boundary detection in at least one original image constituting online cartoon content,
  • An image analyzer for dividing the normalized image into a plurality of blocks having a predetermined size and calculating one or more governing slopes for each block based on Histogram of Oriented Gradient (HOG)
  • HOG Histogram of Oriented Gradient
  • a feature point extracting unit for generating feature point information of N-bit values obtained by binarizing the at least one governing slope for each block constituting the ROI according to a preset reference, corresponding to the ROI;
  • an image corresponding to the original image And the feature point information corresponding to the identification object image is generated by controlling the ROI extraction unit, the normalization unit, the image analysis unit, and the feature point extraction unit when receiving the identification target image, And a controller that compares the reference minutia information with the reference minutia information and provides content information matched with mutually matching reference minutia information in association with
  • the content information may include a rotation information for a specific rotation of the on-line cartoon content.
  • the ROI extracting unit detects the boundary line by scanning the original image in the horizontal and vertical directions, and when the source images constituting the online comic contents are plural, the source images are sequentially connected And generating a single image and then detecting the boundary line.
  • the ROI extracting unit may extract the ROI from the original ROI image if the ROI exists in the ROI, And the extracted region of interest is connected to the specific region of interest and is set as one region of interest and extracted.
  • the feature point extracting unit may divide a unit block into a plurality of cells of a predetermined number, calculate a magnitude of a directional gradient by collecting a slope calculated for each unit cell based on HOG, At least one dominant gradient having a magnitude equal to or larger than the magnitude of the unit block is calculated corresponding to the unit block.
  • the feature point extracting unit may determine whether or not a ruling slope exists for each of a plurality of predetermined angular ranges according to the directions of the at least one ruling slopes, and determine whether or not the ruling slope exists for each of the plurality of angle ranges And then the binarization process is performed.
  • control unit may further include a storage unit for storing the reference minutia information and the content information in a matching manner under the control of the control unit.
  • control unit identifies content information according to reference minutia information matching the minutia information of each of the plurality of ROIs when the target image includes a plurality of ROIs,
  • the contents information most corresponding to the identified object image is provided as the contents information corresponding to the identification object image.
  • An on-line cartoon identification method includes: receiving an image to be identified; extracting a region of interest through boundary detection of the image to be identified; generating a normalized image obtained by normalizing the region of interest to a predetermined normalization size; Dividing the normalized image into a plurality of blocks having a preset size, calculating at least one dominant slope for each block on the basis of a Histogram of Oriented Gradient (HOG), calculating the at least one dominant slope for each block constituting the ROI
  • the N-bit binarization process is performed by binarizing the gradient according to a preset reference Comparing the minutia information with the reference minutia information to generate minutia information corresponding to the minutia information when the minutia information corresponding to the minutia information is
  • the present invention identifies a region of interest composed of one meaningful scene (or cut) in an image, extracts and normalizes the region of interest, and then extracts feature points for the region of interest through HOG-based image analysis, It is possible to compare minutiae points of interest between the image and the identification target image, thereby making it possible to greatly improve the processing speed in the process of identifying the on-line cartoon content related to the identification target image by comparing the original image with the scene unit excluding the unnecessary background It is possible to accurately compare the minutiae points of the original image and the identification target image because the minutiae point related characteristics based on the HOG are not changed and compared with each other in the normalized region of interest even when the identification target image is configured in various sizes, Associated Online Only It has the effect of greatly improving the identification accuracy of the content.
  • the feature point can be calculated by binarizing the governing slope extracted through the HOG-based image analysis algorithm, Not only the number of feature points extracted corresponding to one image can be reduced as compared with the conventional feature point calculation method but also the feature point comparison is performed in units of scenes to improve the identification accuracy while minimizing the influence of changes in image quality and resolution.
  • FIG. 1 is a block diagram of an on-line cartoon identification system based on a region of interest according to an embodiment of the present invention
  • FIG. 2 through FIG. 4 illustrate a process of extracting a ROI of an ROI based on a ROI according to an embodiment of the present invention
  • FIG. 5 to FIG. 7 are diagrams illustrating a feature point extraction process for a ROI-based ROI of an ROI-based on-line cartoon recognition system according to an embodiment of the present invention
  • FIG. 8 to FIG. 9 illustrate an operation example of content identification associated with an identification target image of an online cartoon identification system based on a ROI according to an embodiment of the present invention
  • FIG. 10 is a table for comparison of performance between an on-line cartoon identification system based on a ROI and an existing feature point extraction method according to an embodiment of the present invention.
  • FIG. 11 is a flowchart of a method for identifying an online cartoon based on a region of interest according to an embodiment of the present invention.
  • the unauthorized copying of the on-line cartoon contents may capture a single image (original image) of each of the images, divide the image into a plurality of sizes to generate a plurality of image files, To create illegal copy content and distribute it without permission.
  • minutiae points are extracted based on the frequency characteristics of the image for the whole area of the original image constituting the online comic contents, and based on this, And the on-line cartoon contents are compared with each other, the position and the distribution of the minutiae do not change due to the same frequency characteristics of the illegal copy content and the online comic content due to the pixel change,
  • the present invention proposes a configuration that accurately identifies feature points of pirated contents to increase the accuracy of identification of illegal copy contents.
  • the present invention can further shorten the identification processing time of illegal contents of the existing registered patent, Retract content Some cut scenes image scenes from the original image to be too easily identified by presenting a plan to ensure the comfort of the user's search to search for content based on the image.
  • the term 'scene' as described in the present invention may be defined as a single cut, a single cell, a single panel or a single frame, May mean a comic image or an image area comprising a single cut, a single frame, a single panel or a single frame.
  • the original image may be composed of one or more cuts, squares, panels, or frames.
  • a plurality of cuts, a plurality of cells, a plurality of panels, or a plurality of frames may be constituted by one region of interest according to the arrangement of the cuts or cells constituting the original image.
  • FIG. 1 is a block diagram of a system for identifying an on-line cartoon based on a ROI according to an embodiment of the present invention.
  • the ROI extraction unit 110 the normalization unit 120, the image analysis unit 130, An extraction unit 140 and a control unit 150.
  • the on-line comic book identification system may be included in the other components, and in addition to the components described above, the on-line comic book identification system may further comprise additional components .
  • each constituent unit constituting the on-line comic book identification system may communicate with each other by configuring at least a part of the components of the on-line comic book identification system in each of a plurality of different apparatuses that are configured in the server or mutually communicable.
  • the interest region extracting unit 110, the normalizing unit 120, the image analyzing unit 130, and the feature point extracting unit 140 are configured in the server, and the control unit 150 controls the terminal , A user terminal).
  • the on-line cartoon identification system may be composed of application-related data executed in a server or a user terminal.
  • the ROI extracting unit 110 may extract one or more original images constituting the online comic contents for each rotation.
  • the server may include a content DB 101 matching one or more original images and content information stored in the content matching the online cartoon (or online cartoon content) related content information, And one or more original images may be stored in the content DB 101.
  • the control unit 150 may extract an original image matched with specific content information from the content DB 101 and provide the extracted original image to the ROI extraction unit 110.
  • the control unit 150 may extract Matching with the specific content information extracted together with the original image when receiving the minutia information, and storing the matched information in the minutia DB 102 included in the server.
  • the content information may include content identification information corresponding to on-line cartoon content, and rotation information on any one of a plurality of rotation angles constituting the on-line cartoon content, and the rotation information may include a plurality of rotation numbers Image identification information corresponding to (or matched with) any one of the original images.
  • content information corresponding to each of a plurality of different time series corresponding to a specific online cartoon content can be stored in advance in the content DB 101, and a plurality of differently differentiated content
  • the information may include mutually different pieces of discrepancy information including mutually identical pieces of content identification information.
  • date of creation or the date of publication may be different from each other between the original images of different times, and information on the date may be included in the time difference information.
  • the content DB 101 may store and store the content information and the at least one original image for each of a plurality of different online cartoons (or for each of a plurality of different online comic contents).
  • the ROI extracting unit 110 may detect the boundary (or edge) by scanning the original image in the horizontal direction and the vertical direction when receiving the original image, (Or set) an ROI (Region Of Interest) for one meaningful scene (or cut or frame) in the original image according to the boundary detection.
  • the ROI extracting unit 110 may exclude the region of interest when the upper or lower end of the ROI is located at the upper or lower end of the original image, A second original image of the next or previous sequence is extracted from the content DB 101 and then successively scanned subsequent to the first original image to form a first region of interest that is in contact with the upper or lower end of the first original image,
  • the second region of interest which is in contact with the upper or lower end of the image and which follows the first region of interest may be interconnected and selected (or set) as one region of interest.
  • the interest area extracting unit 110 sequentially connects the plurality of original images according to the identification information of the original images, It can be created as a single image.
  • the identification information of the original image may be a file name of the original image.
  • the ROI extracting unit 110 may detect the boundary line by scanning the single image in the horizontal direction and the vertical direction.
  • the ROI extracting unit 110 may extract a single area, which is closed by the boundary line, Area can be selected.
  • the region of interest may include a single scene (or a single cut or a single frame) included in the original image, or a cartoon component such as a metabolism, a fingerprint, a simple word, and the like.
  • the ROI extracting unit 110 extracts an image corresponding to the ROI from the original image each time the ROI is detected in the original image, and provides (or transmits) the ROI-related image to the normalization unit 120, can do.
  • the on-line cartoon identification system extracts a feature point through HOG (Histogram of Oriented Gradient) based image analysis for the ROI, and uses the feature point as an identification means for on-line cartoon content.
  • HOG Hemogram of Oriented Gradient
  • the normalization unit 120 receives the ROI related image provided from the ROI extraction unit 110, and normalizes the ROI-related image with a predetermined normalization size, Images can be generated.
  • the normalization unit 120 may normalize the original image according to a predetermined normalization size or a normalization ratio. For example, the normalization unit 120 may adjust the width of the original image to a predetermined number of pixels, The number of vertical pixels of the original image can be automatically adjusted according to the adjustment ratio of the width.
  • the normalization unit 120 provides (or transmits) the normalized image to the image analysis unit 130 and the image analysis unit 130 converts the normalized image into a predetermined size (or a first size) (Divided) into a plurality of setting areas.
  • the image analyzer 130 divides (divides) a plurality of blocks of a predetermined size (or a second size) for each unit setting area A, and generates a histogram of an Oriented Gradient ) Based image analysis can yield one or more dominant gradients.
  • the image analysis unit 130 divides (divides) a unit block into a plurality of cells having a predetermined size (or a third size), and divides (divides) The slope can be calculated for each cell.
  • the unit block may mean any one of the plurality of blocks.
  • the image analyzer 130 may calculate the magnitude of the gradient of each specific unit block by collecting the slope calculated for each cell belonging to the specific unit block. That is, the image analyzer 130 may calculate a plurality of slopes calculated for each cell belonging to a specific unit block, and calculate a slope-by-slope (or slope-dependent) size.
  • the image analyzer 130 may divide a gradient magnitude by a predetermined gradient angle, which is divided into a predetermined angle interval according to a slope of each cell belonging to the specific unit block according to the HOG algorithm, ), And one or more dominant slopes having sizes equal to or larger than a predetermined reference size in the histogram can be calculated (or extracted) corresponding to the specific unit block.
  • the image analyzer 130 may calculate a histogram according to nine different tilt directions when different tilt directions are set at angular intervals of 40 degrees.
  • the feature point extracting unit 140 extracts a plurality of feature points corresponding to a predetermined unit block in association with the direction of each of the at least one governing slopes calculated in association with the specific unit block, (Or angles) of the gradient slope, and it is possible to binarize the gradient slopes according to the plurality of different angle ranges (or angles).
  • a plurality of different angular ranges may be preset on the basis of a 40-degree angle (or an interval) in the feature point extracting unit 140, and a plurality of bit values for each angle range may constitute minutia point- Can be set in advance. Accordingly, when the angle range is divided by the angle of 40 degrees, the feature point extracting unit 140 can assign 9 bits to the feature point related data for one block.
  • the feature point extracting unit 140 may set the angular range in which the dominant inclination is present to 1 and the angular range in which the dominant inclination does not exist to 0 in accordance with whether the dominant inclination exists or not, Bit data of a predetermined unit block, and extract (or calculate) the data as minutiae of the specific unit block.
  • the feature point extracting unit 140 sets the feature point extracting unit 140 to 1 because the feature point extracting unit 140 has a dominant inclination in an angular range exceeding 0 degrees and 40 degrees or less, which is set in advance for the block 3, Since there is no dominant slope in a preset angle range, it can be set to zero.
  • the feature point extracting unit 140 performs a binary operation according to the presence or absence of a dominant gradient for each of nine different angular ranges obtained by dividing 360 degrees at intervals of 40 degrees, thereby obtaining 9-bit feature points (or feature point information ) Can be calculated.
  • the reference angle for determining (dividing) the angular range that is preset in the feature point extracting unit 140 has been described as an example of 40 degrees. However, it is needless to say that such a reference angle can be changed and set to various angles For example, as the reference angle is lowered, the number of directions and the number of bits of the slope capable of expressing the characteristics of an image can be increased to increase the resolution of the feature points, thereby obtaining more precise feature point information.
  • the minutiae point extracting unit 140 can calculate (generate) 9-bit minutia information for each of a plurality of different blocks constituting the unit setting area A, The minutiae information of 36 bits can be calculated (generated) for the area A.
  • the minutiae point extracting unit 140 may calculate minutia information of 36 bits for each of a plurality of different setting areas constituting one interest area. If one interest area is composed of 9 setting areas, The feature point information of 324 bits can be generated for the region and the feature point for the region of interest can be extracted.
  • the feature point extracting unit 140 can divide the ROI into a plurality of setting areas and blocks, and it is also possible to binarize one or more governing slopes of each block (or convert binary ROI data into binary data)
  • the feature point information of the value can be generated corresponding to the region of interest.
  • the minutiae point extracting unit 140 can generate minutiae point information having a capacity smaller than that of the existing minutiae point extraction method for the ROI, and through the use of the minutia information described below, The processing load can be lowered and the processing speed can be improved.
  • the feature point extracting unit 140 extracts feature points for a plurality of different blocks constituting the ROI, collects the feature point information generated for each block, And then provides (transmits) the minutia information to the control unit 150.
  • the controller 150 may extract one or more original images corresponding to the online comic contents of the specific times from the content DB 101 and then provide the extracted one or more original images to the interest area extraction unit 110,
  • the content information corresponding to the online cartoon content extracted from the content DB 101 may be matched with each other and stored in the minutia DB 102.
  • the controller 150 identifies minutia information generated (or extracted) corresponding to the original image, sets minutia information corresponding to the original image as reference minutia information, and stores the minutia information in the minutia DB 102 And the reference minutia information generated for each region of interest selected from the at least one original image corresponding to a specific position can be matched with the content information and stored in the minutia DB 102.
  • the content DB 101 and the minutia DB 102 may be configured as a single DB.
  • the controller 150 may include a micro controller unit (MCU) and various engines.
  • the controller 150 may include a RAM, a ROM, a CPU, a GPU, and a bus.
  • the CPU accesses the memory, performs booting using an O / S (Operating System) stored in the memory, and can perform various operations using various programs, contents, and data stored in the memory.
  • O / S Operating System
  • control unit 150 may receive an image to be identified from the outside.
  • control unit 150 when the control unit 150 is configured in the server, the control unit 150 receives an image to be identified from an external device through a communication unit configured in the server supporting communication via a communication network with the external device, An additional DB for storing an identification target image may be included and extracted from the additional DB based on an external input through an input unit configured in the server and received.
  • the control unit 150 controls the ROI extracting unit 110, the normalizing unit 120, the image analyzing unit 130, and the feature point extracting unit 140 to generate feature point information And then compared with the reference minutia information stored in the minutia DB 102.
  • control unit 150 may provide the ROI extractor 110 with the identification image in place of (or in place of) the original image in the above-described configuration, and the ROI extractor 110 ), The normalization unit 120, the image analysis unit 130, and the feature point extraction unit 140, similar to the method of generating the feature point information for the ROI from the original image, And generate feature point information for each ROI corresponding to the ROI.
  • the control unit 150 may further include a feature point extracting unit 140 that extracts feature point information obtained from the ROI extracting unit 110, the normalizing unit 120, the image analyzing unit 130, and the feature point extracting unit 140, To the plurality of different reference minutia information stored in the minutia DB 102.
  • a feature point extracting unit 140 that extracts feature point information obtained from the ROI extracting unit 110, the normalizing unit 120, the image analyzing unit 130, and the feature point extracting unit 140, To the plurality of different reference minutia information stored in the minutia DB 102.
  • the control unit 150 when the reference feature point information coinciding with the feature point information obtained in correspondence with the identification target image exists in the feature point DB 102, the control unit 150 generates a reference point corresponding to the feature point information of the ROI belonging to the identification target image Content information matching the minutia information can be extracted from the minutia DB 102 and provided as content information related to the identification target image.
  • the control unit 150 determines whether the identification target image corresponds to the specific on-
  • the image processing apparatus may determine that the image is generated by duplicating or clipping at least one or at least one of the at least one original image included in the content information corresponding to the specific rotation, And may provide the content information corresponding to the specific rotation of the content as original content associated with the identification target image.
  • the controller 150 determines that the minutia information of the identification target image and the reference minutia information coincide when the data are compared with each other by a predetermined threshold value or more when the minutia information of the identification target image and the reference minutia information are compared .
  • control unit 150 may display the extracted content information corresponding to the identification target image through a separate display unit connected to the server, The content information may be displayed through a display unit included in the user terminal.
  • the server includes a server controller for performing functions of the interest region extracting unit 110, the normalizing unit 120, the image analyzing unit 130, the feature extracting unit 140, and the controller 150, And a terminal control unit for performing some other functions of the control unit 150 may be configured in a user terminal that communicates with the server through a communication network.
  • the terminal control unit configured in the user terminal may select an image to be identified, which is selected in accordance with user input through a user input unit configured in the user terminal among a plurality of different images stored in the memory unit of the user terminal, To the server.
  • the server control unit configured in the server may include a plurality of different constituent units including the ROI extraction unit 110, the normalization unit 120, the image analysis unit 130, and the feature point extraction unit 140 And controls the ROI extracting unit 110, the normalizing unit 120, the image analyzing unit 130, and the feature point extracting unit 140 when receiving the identification target image from the user terminal, Generates minutia information corresponding to the received identification target image, compares the minutia information with the reference minutia information previously stored in the minutia DB 102, and stores content information matched with the minutia information corresponding to the minutia information about the identification target image Extracted from the minutia DB 102 and transmitted to the user terminal.
  • the terminal control unit of the user terminal may display the corresponding content information on the display unit as content information corresponding to the identification target image when receiving the content information through the communication unit configured in the user terminal.
  • control unit 150 determines that the identification target image is illegal copy content illegally copied based on the content information based on the extracted content information corresponding to the identification target image, Information may be provided.
  • the present invention as in the conventional method of extracting and comparing minutiae with respect to the entire area of the original image constituting the online comic contents, there is a mismatch between the size ratio of the original image and the identification target image,
  • a region of interest composed of one meaningful scene (or cut) in the image is identified, the region of interest is normalized,
  • the feature points can be compared with each other through the method of extracting the feature points through the method of extracting feature points through the method of extracting feature points from the original image and the identification target image, Processing in the identification process The speed can be greatly improved.
  • the identification target image is configured in various sizes, the feature points related to the HOG are not changed in the normalized ROI unit, so that the feature points of the original image and the identification target image can be accurately matched
  • the identification accuracy can be greatly improved.
  • the feature points are extracted with respect to the entire region of the original image, and the number of feature points due to feature point extraction in the frequency domain is considerable
  • the present invention can not only calculate the feature point information of the N-bit value by binarizing the governing slope extracted through the HOG-based image analysis algorithm, but also calculate the feature point information of the N-bit value,
  • the number of minutiae points can be reduced as compared with the conventional method, and the minutiae point comparison is performed in units of a scene, thereby minimizing the influence of changes in image quality and resolution, thereby increasing the identification accuracy.
  • the controller 150 controls the ROI extracting unit 110, the normalizing unit 120, the image analyzing unit 130, (140) to extract the content information matched with the reference minutia information corresponding to the minutia information about the region of interest of the identification target image from the minutia DB (102) and provide the extracted content information as content information corresponding to the identification target image have.
  • the controller 150 may determine whether there are a plurality of ROIs extracted from the identification target image in cooperation with the ROI extractor 110. If the ROI is a plurality of ROIs, the ROI extractor 110, The image analyzing unit 120, the image analyzing unit 130, and the feature point extracting unit 140 to identify the content corresponding to the identification target image in the following manner, and to provide the content information on the identified content.
  • the controller 150 extracts the ROIs from the ROI extracting unit 110, the normalizing unit 120, The feature point extraction unit 140 and the feature point extraction unit 140 to generate feature point information for each of the plurality of different interest regions, thereby extracting feature points for each region of interest.
  • the controller 150 searches the minutia point DB 102 based on the plurality of minutia information for each region of interest generated corresponding to the identification target image from the minutia matching point extracting unit 140, Extracting content information matched with reference feature point information mutually matching with respect to each of the minutia information for each region of interest, and if the extracted minutia information corresponding to each of the minutia information of each region of interest of the identification target image coincides with each other, And can provide the content information extracted from the minutia DB 102 as the identified content corresponding to the target image.
  • the controller 150 extracts specific content information for a specific sequence of the specific on-line cartoon content having the minutiae for each region of interest corresponding to the minutiae of the region of interest according to the minutia information for each region of interest of the identification target image
  • the identification target image may be an image obtained by duplicating the specific content information, and the specific content information may be provided as the original content (or the copy target content) of the identification target image.
  • the controller 150 stores content information matched with the reference minutia information corresponding to the minutia information with respect to each of the minutia information of each region of interest of the identification target image, from the minutia DB 102 Extracts a plurality of pieces of content information corresponding to the identification target image, compares the plurality of pieces of extracted content information with each other, and when the pieces of content information are partially different from each other, As content information.
  • control unit 150 extracts two pieces of first content information for one-time contents of a particular online comic corresponding to the minutia information of the region of interest of the identification target image, When the second and third contents information for each of the third-order contents are extracted one by one, the extracted contents information corresponding to the identification-object image is identified, and compared with each other, (Or identified) first content information as content information corresponding to the identification target image.
  • the controller 150 extracts one or more piece of content information corresponding to the partial feature point information from the feature point DB 102 on a part of a plurality of different pieces of feature point information generated corresponding to the identification target image , And may compare the one or more pieces of content information to provide the most detected (or identified) content information as content information corresponding to the identification target image.
  • controller 150 may set various conditions for identifying the content that is the copy of the image to be identified, and may identify the original content corresponding to the image to be identified according to the condition and provide the same to the user.
  • FIG. 10 is a table showing a comparison of performance between an on-line cartoon identification system based on a region of interest and an existing feature point extraction method according to an embodiment of the present invention.
  • the number of feature points is very small at 61 levels (average 2.87%) per one WebTune, which is an online cartoon content, and even when the feature point DB 102 of the WebTurn rotation is built at 85.6 times that of the existing algorithm, Compared to the existing algorithms, the feature extraction time and the identification time are 2.34 times faster than the average of 0.517 seconds, and the total identification speed is 0.83 seconds on average and 0.38 seconds less.
  • the number of minutiae points extracted from the contents of one turn constituting the online comic contents is configured to be smaller than that of the existing minicomputer, but the identification processing speed and accuracy can be greatly improved as compared with the existing method, Even if the amount is larger than the existing one, it can provide faster identification performance than the existing one.
  • FIG. 11 is a flowchart illustrating a method of identifying an on-line cartoon based on a region of interest according to an embodiment of the present invention.
  • the server including the DB which is matched and stored with the discrimination content information can receive the identification target image from the outside (S1).
  • the reference minutia information may be stored in the DB for each region of interest, and the minutia information may be stored in the DB by matching the content information of the specific minutia.
  • the DB may be a minutia DB 102 or a minutia DB 102.
  • the server may extract a region of interest through boundary detection of the image to be identified (S2).
  • the server may generate a normalized image obtained by normalizing the region of interest to a predetermined normalization size (S3).
  • the server may divide the normalized image into a plurality of blocks having a predetermined size, and calculate one or more dominant slopes for each block based on Histogram of Oriented Gradient (S4).
  • the server can generate N-bit minutia information obtained by binarizing the one or more governing slopes of the block constituting the ROI according to a preset reference (or algorithm) in association with the ROI S5).
  • the server compares the minutia information with the reference minutia information (S6). If the minutia information matches the minutia information, the server extracts content information matching the minutia information from the DB, The identification target image is determined as the content corresponding to the content information, and the corresponding content information may be provided to the user as the content associated with the identification target image (S7).
  • CMOS-based logic circuitry CMOS-based logic circuitry
  • firmware software
  • software or a combination thereof.
  • transistors logic gates
  • electronic circuits in the form of various electrical structures.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Technology Law (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

La présente invention concerne un système et un procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt. Plus particulièrement, la présente invention concerne un système et un procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt, qui peuvent détecter une région d'intérêt respectivement dans une image d'origine constituant un contenu de bande dessinée en ligne fourni en ligne et une image cible d'identification obtenue par duplication d'une partie ou de la totalité de l'image d'origine, et d'identifier un contenu de bande dessinée en ligne correspondant à l'image cible d'identification d'après des points caractéristiques extraits de la région d'intérêt.
PCT/KR2017/013825 2017-11-27 2017-11-29 Système et procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt Ceased WO2019103221A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018541398A JP6648289B2 (ja) 2017-11-27 2017-11-29 関心領域に基づくオンライン漫画識別システムおよび方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0159704 2017-11-27
KR1020170159704A KR101998593B1 (ko) 2017-11-27 2017-11-27 관심 영역 기반 온라인 만화 식별 시스템 및 방법

Publications (1)

Publication Number Publication Date
WO2019103221A1 true WO2019103221A1 (fr) 2019-05-31

Family

ID=66631618

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/013825 Ceased WO2019103221A1 (fr) 2017-11-27 2017-11-29 Système et procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt

Country Status (3)

Country Link
JP (1) JP6648289B2 (fr)
KR (1) KR101998593B1 (fr)
WO (1) WO2019103221A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113989313A (zh) * 2021-12-23 2022-01-28 武汉智博通科技有限公司 基于图像多维分析的边缘检测方法及系统
CN118735925A (zh) * 2024-09-04 2024-10-01 重庆医科大学绍兴柯桥医学检验技术研究中心 一种医学影像关键点关联检测方法及系统

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113177960A (zh) * 2021-05-28 2021-07-27 高小翎 边缘支持背景建模的roi监控视频提取平台
KR102587693B1 (ko) * 2021-10-08 2023-10-12 주식회사 디알엠인사이드 이미지 저작권 보호를 위한 이미지 식별 장치 및 이의 동작 방법
KR20230102646A (ko) * 2021-12-30 2023-07-07 김정태 디지털 만화 제공 방법, 장치 및 시스템
KR20230116280A (ko) * 2022-01-28 2023-08-04 김정태 디지털 만화 제공 방법, 장치 및 시스템
KR102669022B1 (ko) * 2022-11-30 2024-05-24 주식회사 비욘드테크 영역 추출을 이용한 위변조 웹툰 콘텐츠 판단 장치 및 그 방법
KR20250077730A (ko) * 2023-11-24 2025-06-02 김정태 디지털 만화 제공 방법, 장치 및 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140072321A (ko) * 2012-11-30 2014-06-13 (주)모비루스 만화 프레임의 분할 방법 및 분할된 만화 프레임을 휴대 단말기에 표시하는 방법.
KR101676575B1 (ko) * 2015-07-24 2016-11-15 주식회사 카카오 만화 컨텐츠의 공유 영역 추출 장치 및 그 방법
US20170098122A1 (en) * 2010-06-07 2017-04-06 Affectiva, Inc. Analysis of image content with associated manipulation of expression presentation
KR20170055345A (ko) * 2015-11-11 2017-05-19 이미지랩409(주) 만화에서의 이미지 추출과 변형 시스템을 활용한 소셜 네트워크 서비스 및 방법
KR101744614B1 (ko) * 2015-12-21 2017-06-09 주식회사 디알엠인사이드 불법 복제된 온라인 만화 식별 시스템 및 방법

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050026769A (ko) 2003-09-09 2005-03-16 (주) 베타랜드 온라인 만화 불법 복제방지 시스템 및 방법
KR101298937B1 (ko) * 2011-11-11 2013-08-23 서강대학교산학협력단 표지판 인식장치, 표지판 인식방법, 및 이미지 인식방법
JP5880089B2 (ja) * 2012-01-31 2016-03-08 凸版印刷株式会社 コミック画像データ検出装置及びコミック画像データ検出プログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170098122A1 (en) * 2010-06-07 2017-04-06 Affectiva, Inc. Analysis of image content with associated manipulation of expression presentation
KR20140072321A (ko) * 2012-11-30 2014-06-13 (주)모비루스 만화 프레임의 분할 방법 및 분할된 만화 프레임을 휴대 단말기에 표시하는 방법.
KR101676575B1 (ko) * 2015-07-24 2016-11-15 주식회사 카카오 만화 컨텐츠의 공유 영역 추출 장치 및 그 방법
KR20170055345A (ko) * 2015-11-11 2017-05-19 이미지랩409(주) 만화에서의 이미지 추출과 변형 시스템을 활용한 소셜 네트워크 서비스 및 방법
KR101744614B1 (ko) * 2015-12-21 2017-06-09 주식회사 디알엠인사이드 불법 복제된 온라인 만화 식별 시스템 및 방법

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113989313A (zh) * 2021-12-23 2022-01-28 武汉智博通科技有限公司 基于图像多维分析的边缘检测方法及系统
CN118735925A (zh) * 2024-09-04 2024-10-01 重庆医科大学绍兴柯桥医学检验技术研究中心 一种医学影像关键点关联检测方法及系统

Also Published As

Publication number Publication date
KR20190061383A (ko) 2019-06-05
JP2020501206A (ja) 2020-01-16
KR101998593B1 (ko) 2019-07-10
JP6648289B2 (ja) 2020-02-14

Similar Documents

Publication Publication Date Title
WO2019103221A1 (fr) Système et procédé permettant d'identifier une bande dessinée en ligne en fonction d'une région d'intérêt
WO2016163755A1 (fr) Procédé et appareil de reconnaissance faciale basée sur une mesure de la qualité
JP2975629B2 (ja) 画像認識装置
JPH03231381A (ja) 指紋照合方法
WO2015174647A1 (fr) Procédé d'authentification d'utilisateur, dispositif pour l'exécuter et support d'enregistrement pour le stocker
KR101744614B1 (ko) 불법 복제된 온라인 만화 식별 시스템 및 방법
WO2014204110A1 (fr) Procédé et appareil pour reconnaissance et authentification d'empreintes digitales
WO2010041836A2 (fr) Procédé de détection d'une zone de couleur peau à l'aide d'un modèle de couleur de peau variable
WO2012118283A2 (fr) Système portable pour faire appliquer des règles en vigueur pour lutter contre des activités illégales et des violations de trafic
WO2021246822A1 (fr) Procédé et appareil pour améliorer une image d'objet
WO2021132829A1 (fr) Procédé d'extraction d'image de bord de toit permettant d'installer un panneau solaire au moyen d'un apprentissage automatique
WO2018117353A1 (fr) Procédé de détection de limite entre l'iris et la sclérotique
EP3459009A2 (fr) Procédé de quantification adaptative pour codage d'image d'iris
CN106991448A (zh) 一种人像比对处理方法
CN109698906A (zh) 基于图像的抖动处理方法及装置、视频监控系统
WO2022092743A1 (fr) Procédé d'extraction de caractères de plaque d'immatriculation de véhicule et dispositif d'extraction de caractères de plaque d'immatriculation pour appliquer le procédé
JPH10191027A5 (fr)
WO2016108562A1 (fr) Système de codage et de reconnaissance d'informations d'empreinte digitale, et son procédé de fonctionnement
WO2023058816A1 (fr) Appareil d'identification d'image pour protection des droits d'auteur d'image et son procédé de fonctionnement
WO2019117379A1 (fr) Dispositif et procédé d'authentification biométrique basé sur une image oculaire dans un dispositif d'affichage vestimentaire
WO2020022597A1 (fr) Appareil pour commander un enregistrement d'empreinte digitale et une authentification d'empreinte digitale et son procédé de commande
WO2021071258A1 (fr) Dispositif et procédé d'apprentissage d'image de sécurité mobile basés sur l'intelligence artificielle
WO2023075183A1 (fr) Système et procédé de reconnaissance d'empreinte palmaire sans contact basés sur un apprentissage profond
JP2001202516A (ja) 個人識別装置
KR101841192B1 (ko) 온라인 만화 식별 시스템 및 방법

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018541398

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17933129

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17933129

Country of ref document: EP

Kind code of ref document: A1