WO2020141803A2 - Procédé pour fournir un service de recommandation d'article de mode à un utilisateur - Google Patents

Procédé pour fournir un service de recommandation d'article de mode à un utilisateur Download PDF

Info

Publication number
WO2020141803A2
WO2020141803A2 PCT/KR2019/018513 KR2019018513W WO2020141803A2 WO 2020141803 A2 WO2020141803 A2 WO 2020141803A2 KR 2019018513 W KR2019018513 W KR 2019018513W WO 2020141803 A2 WO2020141803 A2 WO 2020141803A2
Authority
WO
WIPO (PCT)
Prior art keywords
user
image
fashion
item
style
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2019/018513
Other languages
English (en)
Korean (ko)
Other versions
WO2020141803A3 (fr
Inventor
유애리
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Odd Concepts Inc
Original Assignee
Odd Concepts Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Odd Concepts Inc filed Critical Odd Concepts Inc
Publication of WO2020141803A2 publication Critical patent/WO2020141803A2/fr
Publication of WO2020141803A3 publication Critical patent/WO2020141803A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection

Definitions

  • the present invention relates to a method of providing a fashion item recommendation service to a user, and more particularly, to a service providing method of recommending a fashion item to a user using an image acquired from a user device.
  • the following is to provide a service for recommending a fashion item to a user using an image acquired from a user device.
  • a method of providing a fashion item recommendation service to a user using a service server which is an aspect of the present invention for solving the above-described problem, checks whether an authority to acquire an image from a user device exists, and Obtaining an image capable of identifying the user when authority exists; Generating a user fashion database by extracting a plurality of fashion items worn by the user from an image capable of identifying the user; When a request for a recommendation service for a specific fashion item stored in the generated user fashion database is received, a style composed of style images from which style labels are extracted by combining a plurality of fashion items to express a person's feelings as data recognizable by a computer.
  • the method may further include adding a fashion item for the product image to the user fashion database.
  • information on the plurality of fashion items is sorted and stored based on the user face image extracted from the image capable of identifying the user, and the plurality of fashion items are stored.
  • the information on may include at least one of a size of a fashion item, a label expressing a feeling that a person feels in a fashion item as computer-recognizable data, and image information when the user is fitted.
  • the determined recommended product is based on a label extracted from the content of the product and information on the plurality of fashion items stored in the user fashion database, so that the user's fit is predictable. It may be characterized in that provided.
  • the method may further include providing a product ordering service through a web page for the recommended product.
  • a style label represented by computer-recognizable data is extracted from at least one fashion item included in the style image, and the style image is clustered and generated based on the extracted style label. It may be characterized by consisting of at least one style book (style book) that shares the style label of.
  • FIG. 1 is a flowchart illustrating a message transmission process transmitted between the service server 101 and the user device 103 according to an embodiment of the present invention.
  • FIG. 2 is a reference diagram for explaining a method of providing a fashion item recommendation service by a service server according to an embodiment of the present invention.
  • the user device on which the product information is displayed is a mobile device, but the present invention is not limited thereto. That is, in the present invention, the user device should be understood as a concept including all types of electronic devices capable of requesting search and displaying advertisement information, such as a desktop, a smart phone, and a tablet PC.
  • the term displayed on a user device refers to a screen loaded on an electronic device and/or content inside the screen so that it can be immediately displayed on the screen according to the user's scroll. It can be understood as an inclusive concept.
  • an entire execution screen of an application that is extended in a horizontal or vertical direction and displayed according to a user's scroll may be included in the concept of the page, and the screen being rolled by the camera may also be included in the concept of the page.
  • FIG. 1 is a flowchart illustrating a message transmission process transmitted between the service server 101 and the user device 103 according to an embodiment of the present invention.
  • a user-customized product recommendation service based on an image stored in a user device may be provided. For example, among images stored in the user device, images that can be identified by the user are image-processed, and the fashion items worn by the user are extracted and sorted based on the user's face, and then based on the fashion items You can provide recommended products. If a user named A wears a white bag and a brown suit on the user device,'white bag' and'brown suit' are sorted in the user fashion database based on the face of the user A. Can be saved.
  • the service server uses a fashion magazine or the like to retrieve a picture matching the brown suit and shoes from the style database. As a basis, you can recommend coordination items.
  • the service server 101 when receiving a request for a style recommendation for the brown suit, the service server 101 refers to the previously created style database, product database, and user fashion database, and goes well with the brown suit and matches the shoe category. Can recommend items, and provide online market information of recommended shoes.
  • the service server may determine an item similar to the requested item by first searching the style database based on the image similarity of the fashion item object when the user inquires by specifying any fashion item on the user fashion database. Thereafter, the service server may check other items that are matched with the similar item in the image included in the style database, and determine a coordination item by reflecting user size information among the other items.
  • the service server may search the product database based on the image similarity for the coordination item and set a priority according to the user size information to determine the recommended product.
  • the service server 101 needs to check whether or not there is an authority to acquire an image from the user device 103. If the service server does not have the authority to acquire the image from the user device, the service server may request the image authority from the user device (S110). For example, in order to provide a recommendation service, authority for a photo album, album, etc. stored in a user device may be requested.
  • the user may proceed to grant the image authority thereto (S120), and accordingly, the service server may provide the user with the recommended service according to the present invention by using the image authority for the user device. Can. If the authority to acquire an image from the user device already exists in the service server, the above-described image permission request step (S110) and the image permission granting step (S120) may be omitted.
  • the service server 110 acquires an image capable of identifying the user (S130 ).
  • the service server may acquire all the images stored in the user device, and among them, only the image identifiable by the user may be used, but only the image for a specific user may be acquired based on the identification information sorted on the user device. It may be.
  • image processing may be performed by acquiring only those images. This can improve the accuracy of the recommended service and prevent unnecessary processing of the server by using the classified image because unnecessary pictures may be included in the user device.
  • the service server 101 generates a user fashion database by extracting a plurality of fashion items worn by the user from an image that can identify the user. If a user can check on a web page (for example, an online shopping mall or a clothing brand homepage) or a linked product image is input, a fashion item for the product image may be added to the user fashion database. For example, a user named A may capture an image from an online page of a shopping mall where a bag is purchased and add it to the user's fashion database. When entering a link to a specific site, the image of the site is added to the user's fashion database. It can be.
  • the user fashion database may include information on fashion items, such as the size of the fashion item, a label expressing the feeling of a person in the fashion item as computer-recognizable data, and a picture when the user fits.
  • the user fashion database may include necessary size information such as a user's top, bottom, and dress, and the appearance when fitting the actual clothes is managed as a photograph, so that the user fits considering his body type You can make this possible.
  • the user may refer to the future when considering fit when selecting a fashion item.
  • the service server 101 When the service server 101 receives a recommendation service request for a specific fashion item stored in the user fashion database generated as described above from the user device 103 (S140), the specific fashion item based on the image similarity from the style database Search for similar items. When a similar item is searched, the service server determines an item of a category different from the similar item from the style image in which the similar item is searched as a coordination item.
  • the service server may determine a product similar to the coordination item as a recommended product based on the image similarity from the product database and provide it to the user (S150). At this time, the service server may provide the user with a predictable fit when the recommended product is purchased based on information on fashion items included in the user fashion database. If there is a label extracted from the content of the product in the product database, it may be provided to the user along with information on fashion items included in the user fashion database.
  • the service server may provide the product ordering service through the web page for the recommended product according to the user's selection.
  • FIG. 2 is a reference diagram for explaining a method of providing a fashion item recommendation service by a service server according to an embodiment of the present invention.
  • the service server acquires an image capable of identifying a user from a user device (S210).
  • a method of acquiring an image an image may be acquired from a user device, or a product image that may be viewed or linked on a web page (eg, an online shopping mall or a clothing brand homepage) may be input from the user.
  • the service server generates a user fashion database from the acquired image (S220).
  • a fashion item extracted from an image may be stored in the user fashion database, and furthermore, the user fashion database is a fashion item size, a label expressing a feeling that a person feels in a fashion item as computer-recognizable data, and an image when the user fits.
  • Information may be included, or information that can estimate a user's taste, such as user's purchase data and viewing time data, user's size information, and information on a preferred price, use, and brand when shopping online for fashion items. .
  • the user fashion database may include user identification information, user behavior information for estimating the user size, user size estimated from the behavior information, and user size information directly received from the user device.
  • the service server provides a query to the user device for the user's age, gender, occupation, fashion field of interest, reserved items, etc., receives user input for the query, generates user size information, and generates the user fashion. It can be reflected in the database.
  • the service server is a time when a user browses an arbitrary style book provided through an application according to an embodiment of the present invention, item information generated like a tag, request item, fashion item information purchased through the application or another application, and By combining user behavior information for estimating the user size, such as time information at which the information is generated, preference information for a style in which the user is interested in the corresponding time may be generated and reflected in the user fashion database.
  • the service server may generate the user's body shape information and reflect it in the user fashion database.
  • the service server models a user's body model from a machine learning framework that learns human body features from a large number of body images. You can create The user body model may include information about the proportions and skin tones of each part of the user's body as well as the size information of each part of the user's body.
  • the service server may generate preference information for a user's fashion item and reflect it in the user fashion database.
  • the preference information may include information about a user's preferred price, preferred brand, and preferred use. For example, when a user browses or purchases a fashion item through an online market on a user device, the service server reflects different weights for viewing or purchasing to generate information about a preferred price, a preferred brand, and a preferred use, and the user fashion database. Can be reflected in.
  • the service server has a feature of estimating a user's “flavor” corresponding to a human feeling, and generating the estimated taste information in a form recognizable by a computer and reflecting it in a user fashion database.
  • the service server may extract a label for estimating the user's taste from the user's behavior information.
  • the label may be extracted as the meaning of fashion items included in user behavior information, such as a style book viewed by a user, an item that generates a tag like a tag, a request item, or a purchase item.
  • the label may be generated as information about a look and feel, such as the appearance and feel of fashion items included in user behavior information, and trends.
  • the label generated from the user behavior information is weighted according to the user behavior, and the service server may generate user size information for estimating the user size by combining it and store it in the user fashion database.
  • the user size information, user body shape information, and user preference information included in the user fashion database may be used to set the exposure priority for the recommended item or the recommended product.
  • the service server When the service server receives a recommendation service request for a specific fashion item stored in the user fashion database, the service server searches for an item similar to a specific fashion item based on the image similarity from the style database (S230). For example, the user may select a photo of a specific fashion item of the user device, and send a request to the product server for requesting product information of the corresponding fashion item, or a recommendation of a coordination item suitable for it.
  • the user device may first determine whether an object of a preset category is included in the displayed image, and may specify the object as a specific fashion item by specifying the object.
  • the image may include multiple fashion items. When an object for the object is included, each object may be specified and operated to transmit only a request for the object selected by the user.
  • the style database may include information about a fashion style, a fashion image that can be referenced for coordination of multiple items, among images collected on the web.
  • the style database may include, among images collected online, images combined with a plurality of fashion items to match well (referred to herein as a style image) and classification information for the style image.
  • the style image according to the embodiment of the present invention is a fashion catalog, a fashion magazine pictorial image, a fashion show shooting image, an idol costume image, a specific drama that can be collected on the web as image data generated by combining a plurality of fashion items in advance by an expert or an expert Or, you can exemplify a movie's costume image, SNS, blog celebrity's costume image, fashion magazine's street fashion image, or an image coordinated with other items to sell fashion items.
  • the style image is stored in a style database according to an embodiment of the present invention, and can be used to determine other items that go well with a particular item.
  • the style image can be used as a reference for a computer to understand the human feeling that it is generally “fits well”. Machine learning learned about matching of multiple fashion items in order for the computer to recommend another item that “matches well” without human intervention for any item, because “being good” with any item is about the human feeling. You will need a framework.
  • the service server may collect a plurality of fashion items combined by an expert or a semi-expert and collect a style image worn by a person and generate it as a style database.
  • the service server can train the framework by applying the style database to the machine learning framework.
  • a machine learning framework that has learned a large number of style images with matching blue shirts and brown ties could recommend brown ties as a coordination item for requests for blue shirts.
  • the service server may collect style images online.
  • the service server collects a list of web addresses such as fashion magazines, fashion brands, drama makers, celebrity planners, SNS, online stores, etc., and checks the website to track the link. Can be collected.
  • the service server can collect and index images from websites such as fashion magazines, fashion brands, drama makers, celebrity planners, SNS, online stores, etc. Information may be provided separately.
  • the service server may filter images that are not suitable for style recommendation among the collected images.
  • the service server may filter the remaining images, leaving only the images containing the human-shaped objects among the collected images and the plurality of fashion items.
  • Filtering images for a single fashion item is appropriate because the style image is used to determine the request item and other items that can be coordinated. Furthermore, constructing a database with images of a person wearing a plurality of fashion items directly may be more useful than images of the fashion items themselves. Therefore, the service server according to an embodiment of the present invention may determine the style image included in the style database by filtering the remaining images, leaving only the image including the human-shaped object and the plurality of fashion items.
  • the service server may process features of the fashion item object image included in the style image. More specifically, the service server may extract image features of the fashion item object included in the style image, express feature information as vector values, generate feature values of the fashion item object, and structure feature information of the images.
  • the service server may extract a style label from a style image and cluster style images based on the style label. It is appropriate that the style label is extracted with respect to the look and feel of the fashion item's appearance, feel, and trends. According to a preferred embodiment of the present invention, it is possible to extract a label for a feeling that a person can feel from the appearance of a single fashion item included in a style image, a combination of a plurality of items, and use it as a style label. For example, a celebrity look, a magazine look, a summer look, a feminine look, a sexy look, an office look, a drama look, and a Chanel look can be illustrated as style labels.
  • the service server defines a style label in advance, generates a neural network model learning the characteristics of the image corresponding to the style label, classifies objects in the style image, and extracts the label for the object can do.
  • the service server may assign the corresponding label to the image matching the specific pattern with a random probability through the neural network model learning the pattern of the image corresponding to each label.
  • the service server may learn characteristics of an image corresponding to each style label to form an initial neural network model, and apply a large number of style image objects to it to expand the neural network model more precisely. have.
  • the service server may apply style images to a neural network model formed of a hierarchical structure formed of a plurality of layers without separate learning of labels. Furthermore, weighting is applied to the feature information of the style image according to the request of the corresponding layer, and the product images are clustered using the processed feature information, and the celebrity look, magazine look, summer look, feminine look, and sexy look to the clustered image group , Labels that are interpreted ex post as office look, drama look, or chanel look can be given.
  • the service server may cluster style images using a style label and generate a plurality of style books. This is to be provided as a reference to the user.
  • the user may browse a specific style book among a plurality of style books provided by the service server, find a favorite item, and request a product information search for the corresponding item.
  • the service server may pre-classify items having a very high appearance rate, such as white shirts, jeans, and black skirts.
  • items having a very high appearance rate such as white shirts, jeans, and black skirts.
  • jeans are very basic items in fashion, so the appearance rate in style images is very high. Therefore, no matter what item the user inquires about, the probability of matching jeans as a coordination item will be significantly higher than other items.
  • the service server can pre-classify an item having a very high appearance rate in a style image as a buzz item, and generate a style book with different versions, including a buzz item and a buzz item. have.
  • buzz items may be classified by reflecting time information. For example, considering the fashion cycle of a fashion item, it is possible to consider items that fad and disappear for a month or two, fashion items that return each season, and items that are continuously fashionable for a certain period of time. Therefore, by reflecting time information in the classification of the buzz item, if a specific fashion item has a very high appearance rate during an arbitrary period, the item may be classified as a buzz item along with information on the corresponding period.
  • the buzz item is classified as described above, in the subsequent item recommendation step, there is an effect that can be recommended in consideration of whether the item to be recommended is fashionable or unrelated to fashion.
  • the service server can process a specific fashion item object included in the received request, and search a style database based on image similarity. That is, the service server may search for a similar item in the style database by processing an image object specified as a search target.
  • the service server may extract characteristics of the image object to be searched and structure specific information of images for efficiency of search.
  • the service server can extract label and/or category information on the meaning of the object image to be searched by applying the machine learning technique used to construct the product image database to the processed object image to be processed.
  • the label may be expressed as an abstracted value, but may also be expressed in text form by interpreting the abstracted value.
  • the service server may extract labels for women, dresses, sleeveless, linen, white, and casual look from the request object image.
  • the service server may use labels for women and dresses as category information of the requested object image, and labels for sleeveless, linen, white, and casual look may be used as label information describing characteristics of the object image outside the category. .
  • the service server may search the style database based on the similarity of the request object image. This is for retrieving items similar to the request image from the style database to identify other items matching the similar items in the style image. For example, the service server may display the request object image and the fashion item object images included in the style image. The similarity of the feature values can be calculated, and an item whose similarity is within a preset range can be checked.
  • the service server processes the feature values of the request image by reflecting the weights required by the multiple layers of the artificial neural network model for machine learning configured for the product database, and within a certain range with the request image At least one fashion item group included in a style book having a distance value may be selected, and items belonging to the group may be determined as similar items.
  • the service server determines a similar item by searching the style database based on the similarity of the requested image, and uses label and category information extracted from the image to increase the accuracy of the image search. Can.
  • the service server calculates the similarity between the feature values of the requested image and the style database image, and among the products having a similarity of a predetermined range or higher, the label and/or category information does not match the label and/or category information of the requested image. Similar items can be determined by excluding products.
  • the service server may calculate the item similarity only in the style book having label and/or category information matching the label and/or category information of the request image.
  • the service server may extract a style label from a request image, and specify a similar item based on the request and image similarity in a style book matching the label.
  • the service server may specify a similar item based on the similarity of the requested image and the image in the style database without extracting a separate label from the requested image.
  • the service server may extract a label of tropical from the request. Thereafter, the service server may identify a similar item having a similarity of a leaf pattern dress and a preset range in a style book clustered with a label of tropical.
  • the service server includes a similar item retrieved from the style book, and may provide a user device with a style image in which the similar item is combined with other fashion items.
  • a style image in which straw hats, rattan bags, etc. are combined with a leaf pattern dress can be provided to the user.
  • the service server determines a coordination item by combining the similar item and checking fashion items of other categories included in the style image (S240).
  • a specific fashion item inquired by the user may be searched based on the image similarity in the style database, and a fashion item of another category matched with the similar item in the style image including the similar item may be considered as a recommended item. This is because the service server according to the embodiment of the present invention is learned to match other items that match with the requested item in the style image.
  • the service server determines a product similar to the coordination item from the product database as a recommended product (S250).
  • the product database may include product detail information such as origin, size, sales place, and wear shot of products sold in the online market, and is characterized by composing product information based on the image of the product.
  • the service server may collect product information for products sold in an arbitrary online market as well as product information of an online market affiliated in advance.
  • the service server may include a crawler, a parser, and an indexer, collect web documents of online stores, and access text information such as product images, product names, and prices included in web documents.
  • a crawler may collect a list of web addresses of an online store, check a website, and track links to deliver data related to product information to a service server.
  • the parser analyzes web documents collected during the crawling process to extract product information such as product images, product prices, and product names included in the page, and the indexer can index the corresponding location and meaning.
  • the service server may collect and index product information from a website of any online store, but may receive product information in a preset format from an affiliate market.
  • the service server can process the product image. This is for determining a recommended item based on whether the product image is similar, without relying on text information such as a product name or a sales category.
  • a recommended item may be determined based on whether the product image is similar, but the present invention is not limited thereto. That is, depending on the implementation, the product image as well as the product name or sales category may be used as a single or secondary request.
  • the service server may generate a database by structuring text information such as a product name and product category other than the product image.
  • the service server can extract the features of the product image and index the feature information of the images for efficiency of search.
  • the service server may detect feature areas of product images (Interest Point Detection).
  • the feature region refers to a main region for extracting a descriptor for a feature of an image, that is, a feature descriptor, to determine whether the images are identical or similar.
  • such a feature area may be a contour that an image includes, a corner such as a corner among contours, a blob separated from the surrounding area, an area that is invariant or covariant according to image deformation, or ambient brightness. It can be a pole with dark or light features, and it can be a patch (fragment) of the image or the entire image.
  • the service server may extract feature descriptors from the feature area.
  • the feature descriptor is a vector value representing features of an image.
  • such a feature descriptor can be calculated using the location of the feature region for the corresponding image, or the brightness, color, sharpness, gradient, scale, or pattern information of the feature region.
  • the feature descriptor may calculate the brightness value of the feature region, the change value of the brightness, or the distribution value by converting it to a vector.
  • the feature descriptor for the image is a local descriptor based on the feature area as described above, as well as a global descriptor, a frequency descriptor, a frequency descriptor, a binary descriptor, or the like. It can be expressed as a neural network descriptor.
  • the feature descriptor is a global descriptor that converts and extracts the brightness, color, sharpness, gradient, scale, pattern information, etc. of each image or a region where the image is divided by an arbitrary reference, or each feature region into a vector value ( Global descriptor).
  • the feature descriptor is a frequency descriptor (Frequency Descriptor) that converts and extracts the number of specific descriptors previously included in the image, the number of inclusions of global features such as a previously defined color table, and the like into a vector value.
  • Binary descriptor which is extracted and used as an integer after extracting in bit units whether the size of each element constituting or including the descriptor is larger or smaller than a specific value, learns from the layer of the neural network Or, it may include a neural network descriptor (Neural Network descriptor) for extracting the image information used for classification.
  • Neural Network descriptor Neural Network descriptor
  • the feature information vector extracted from the product image it is possible to convert the feature information vector extracted from the product image to a lower dimension.
  • the feature information extracted through the artificial neural network corresponds to 40,000-dimensional high-dimensional vector information, and it is appropriate to convert to a low-dimensional vector in an appropriate range in consideration of resources required for search.
  • Various feature reduction algorithms such as PCA and ZCA can be used to transform the feature information vector, and feature information converted into a low dimensional vector can be indexed into a corresponding product image.
  • the service server can extract a label for the meaning of the image by applying a machine learning technique based on the product image.
  • the label may be expressed as an abstracted value, but may also be expressed in text form by interpreting the abstracted value.
  • the service server may define a label in advance, generate a neural network model learning the characteristics of the image corresponding to the label, classify objects in the product image, and extract labels for the corresponding object.
  • the service server may assign the corresponding label to the image matching the specific pattern with a random probability through the neural network model learning the pattern of the image corresponding to each label.
  • the service server may learn characteristics of an image corresponding to each label to form an initial neural network model, and apply a large amount of product image objects to it to expand the neural network model more precisely. Furthermore, the service server may create a new group including the product if the product is not included in any group.
  • the service server predefines a label that can be used as meta information about the product such as female bottoms, skirts, dresses, short sleeves, long sleeves, patterns, materials, colors, and abstract feelings (innocent, chic, vintage, etc.) ,
  • a neural network model learning the characteristics of the image corresponding to the label may be generated, and the neural network model may be applied to the advertiser's product image to extract a label for the product image to be advertised.
  • the service server may apply product images to a neural network model formed of a hierarchical structure formed of a plurality of layers without separate learning of labels. Furthermore, the feature information of the product image may be weighted according to the request of the corresponding layer, and the product images may be clustered using the processed feature information.
  • additional analysis may be necessary to determine whether the corresponding images are clustered according to which attribute of the feature value, that is, to connect the clustering results of the images with a concept that can be recognized by a real human.
  • the service server classifies products into three groups through image processing, and extracts the labels A for characteristics of the first group, B for characteristics of the second group, and C for characteristics of the third group. It needs to be interpreted ex postly, that A, B, and C, respectively, refer to female tops, blouses, and plaids, respectively.
  • the service server is ex post to the clustered image group with female bottoms, skirts, dresses, short sleeves, long sleeves, pattern shape, material, color, abstract feeling (pure, chic, vintage, etc.) Labels that can be interpreted are assigned, and labels assigned to image groups to which individual product images belong can be extracted as labels of corresponding product images.
  • the service server may express a label extracted from a product image as text, and a text-type label may be used as tag information of the product.
  • the tag information of the product is directly and subjectively given by the seller, resulting in inaccuracy and poor reliability.
  • the product tag subjectively assigned by the seller has a problem of lowering the efficiency of search by acting as noise.
  • the tag information of the product is based on the image of the corresponding product. Since it can be extracted mathematically without human intervention, it has the effect of increasing the reliability of the tag information and improving the accuracy of the search.
  • the service server may generate category information of the corresponding product based on the content of the product image. For example, if a label for an arbitrary product image is extracted as a woman, top, blouse, linen, stripe, long sleeve, blue, office look, the service server sets the label for a woman, top, or blouse as the category information of the product. Labels for linen, stripe, long-sleeved, blue, and office look can be used as label information describing the characteristics of products outside the category. Alternatively, the service server may index the corresponding product without distinguishing the label and category information. At this time, the category information and/or label of the product may be used as a parameter to increase the reliability of the image search.
  • the service server determines an item similar to the coordination item from the product database configured by indexing the label extracted from the content of the above-mentioned product as a recommended item, and provides product information for the recommended item, similar to the recommended item You can search for products in the product database.
  • the service server may search the product database based on the image similarity for the coordination item determined using the style database. (Step 190)
  • the service server can extract characteristics of the coordination item object and structure specific information of images for efficiency of search.
  • the service server may search the product database based on the similarity of the object image. For example, the service server may calculate the similarity between the feature values of the recommended item image and the product image included in the product database, and determine a product whose similarity is within a preset range as a recommended product.
  • the service server processes the feature values of the recommended item image by reflecting the weights required by multiple layers of the artificial neural network model for machine learning configured for the product database, and the distance within a certain range At least one product group having a value may be selected, and products belonging to the group may be determined as recommended products.
  • the service server may specify the recommended product based on the label extracted from the recommended item object.
  • the service server searches the object image and the object image to be searched only for product groups that have the female top as category information in the product database. Similarity can be calculated.
  • the service server may set products having a degree of similarity or higher than a predetermined range as a candidate candidate for recommendation, and may exclude products whose sub-category information is not a blouse from the recommended candidate.
  • products with sub-category information indexed as blouses may be selected as advertisement items.
  • the service server in the product database has a woman top, blouse, long sleeve, lace, and collar neck as a label. It is also possible to calculate the similarity between the recommended item and the image for the group only.
  • the service server may determine the priority of exposure by reflecting user preference/size information. For example, when the user is interested in the office look, the weight of the office look label may be used to calculate the priority and provide recommended product information according to the calculated priority.
  • the service for recommending a fashion item to a user using an image obtained from the user device as described above can be applied to various services.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Finance (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

La présente invention concerne un procédé pour fournir un service de recommandation d'article de mode à un utilisateur à l'aide d'un serveur de service. En particulier, le procédé comprend les étapes consistant à : vérifier si la permission d'acquérir une image à partir d'un dispositif d'utilisateur existe, et acquérir une image sur la base de laquelle l'utilisateur peut être identifié lorsque l'autorisation existe; générer une base de données de mode d'utilisateur par extraction d'une pluralité d'articles de mode, portés par l'utilisateur, à partir de l'image sur la base de laquelle l'utilisateur peut être identifié; combiner la pluralité d'articles de mode de façon à rechercher, dans une base de données de style comprenant des images de style à partir desquelles une étiquette de style exprimant un sentiment humain en tant que données reconnaissables par ordinateur est extraite, un article similaire à l'article de mode spécifique sur la base d'une similarité d'image, lorsqu'une demande de service de recommandation pour un article de mode spécifique stocké dans la base de données de mode d'utilisateur créé est reçue; déterminer, pour être un article à coordonner, un article d'une catégorie différente de celle de l'article similaire à partir d'une image de style de laquelle l'article similaire est récupéré; et à déterminer, comme étant un produit recommandé, un produit similaire à l'article à coordonner sur la base d'une similarité d'image à partir d'une base de données de produits configurée par indexation d'étiquettes extraites du contenu de produits.
PCT/KR2019/018513 2019-01-04 2019-12-26 Procédé pour fournir un service de recommandation d'article de mode à un utilisateur Ceased WO2020141803A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020190001230A KR102285942B1 (ko) 2019-01-04 2019-01-04 사용자에게 패션 아이템 추천 서비스를 제공하는 방법
KR10-2019-0001230 2019-01-04

Publications (2)

Publication Number Publication Date
WO2020141803A2 true WO2020141803A2 (fr) 2020-07-09
WO2020141803A3 WO2020141803A3 (fr) 2020-10-15

Family

ID=71406912

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/018513 Ceased WO2020141803A2 (fr) 2019-01-04 2019-12-26 Procédé pour fournir un service de recommandation d'article de mode à un utilisateur

Country Status (2)

Country Link
KR (1) KR102285942B1 (fr)
WO (1) WO2020141803A2 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102814784B1 (ko) * 2022-01-28 2025-05-30 옴니어스 주식회사 스타일 추천 서비스를 제공하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체
KR102761366B1 (ko) * 2022-03-24 2025-02-03 쿠팡 주식회사 아이템 추천 방법 및 그 장치
KR102828131B1 (ko) * 2022-05-20 2025-07-03 옴니어스 주식회사 스타일 추천 서비스를 제공하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104850616B (zh) * 2009-12-24 2018-07-10 株式会社尼康 检索辅助系统、检索辅助方法以及检索辅助程序
JP5476236B2 (ja) * 2010-07-02 2014-04-23 日本電信電話株式会社 コーディネート推薦装置、コーディネート推薦方法及びそのプログラム
KR20130049376A (ko) * 2011-11-04 2013-05-14 한국전자통신연구원 개인별 의상 추천 장치 및 방법
KR20180005625A (ko) * 2016-07-06 2018-01-16 주식회사 케이티 가상 피팅 서비스의 제공 방법 및 장치
KR101886161B1 (ko) * 2017-12-05 2018-08-07 엄나래 Ai 기반 개인 의류 토탈 관리 서비스 제공 방법

Also Published As

Publication number Publication date
KR20200085106A (ko) 2020-07-14
KR102285942B1 (ko) 2021-08-04
WO2020141803A3 (fr) 2020-10-15

Similar Documents

Publication Publication Date Title
WO2020171535A2 (fr) Procédé pour fournir un service de recommandation d'article de mode en utilisant la forme du corps et l'historique d'achats de l'utilisateur
WO2020085786A1 (fr) Procédé de recommandation de style, dispositif et programme informatique
US10747826B2 (en) Interactive clothes searching in online stores
KR102295459B1 (ko) 사용자에게 날짜를 이용하여 패션 아이템 추천 서비스를 제공하는 방법
KR102037489B1 (ko) 이미지 기반 광고 제공 방법, 장치 및 컴퓨터 프로그램
KR102102571B1 (ko) 온라인 쇼핑 플랫폼을 제공하는 시스템 및 방법
WO2020138941A2 (fr) Procédé de fourniture de service de recommandation d'article de mode à un utilisateur au moyen d'un geste de glissement
KR102358775B1 (ko) 패션 상품 추천 방법, 장치 및 컴퓨터 프로그램
WO2020141802A2 (fr) Procédé pour fournir un service de recommandation d'article de mode à un utilisateur en utilisant une date
KR20210131198A (ko) 추천 상품 광고 방법, 장치 및 컴퓨터 프로그램
WO2020251174A1 (fr) Procédé permettant de faire la publicité d'un article de mode personnalisé pour l'utilisateur et serveur exécutant celle-ci
WO2021215758A1 (fr) Procédé de publicité pour article recommandé, appareil et programme informatique
WO2020141803A2 (fr) Procédé pour fournir un service de recommandation d'article de mode à un utilisateur
KR20220039697A (ko) 코디네이션 패션 아이템을 추천하는 방법
KR102378072B1 (ko) 코디네이션 패션 아이템을 추천하는 방법
WO2020141799A2 (fr) Procédé pour fournir un service de recommandation d'article de mode à un utilisateur au moyen de données de calendrier
KR102062248B1 (ko) 온라인 신문기사의 아티클 이미지를 분석하여 매칭되는 커머셜 이미지를 노출하는 방법
WO2021107556A1 (fr) Procédé pour fournir un article recommandé sur la base d'informations d'événement d'utilisateur et dispositif pour l'exécuter
JP7706005B2 (ja) 情報処理装置、情報処理方法および情報処理プログラム
KR20240177800A (ko) 인공지능 채팅로봇을 이용한 고객문의에 대한 응답 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19907378

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19907378

Country of ref document: EP

Kind code of ref document: A2