FR3108995B3 - Apprentissage de renforcement pour l’ergonomie des sites Web - Google Patents

Apprentissage de renforcement pour l’ergonomie des sites Web Download PDF

Info

Publication number
FR3108995B3
FR3108995B3 FR2003313A FR2003313A FR3108995B3 FR 3108995 B3 FR3108995 B3 FR 3108995B3 FR 2003313 A FR2003313 A FR 2003313A FR 2003313 A FR2003313 A FR 2003313A FR 3108995 B3 FR3108995 B3 FR 3108995B3
Authority
FR
France
Prior art keywords
reinforcement learning
learning module
website
search
web server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR2003313A
Other languages
English (en)
Other versions
FR3108995A3 (fr
Inventor
Thierry Delahaye
David Renaudie
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amadeus SAS
Original Assignee
Amadeus SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Amadeus SAS filed Critical Amadeus SAS
Priority to FR2003313A priority Critical patent/FR3108995B3/fr
Priority to US17/204,469 priority patent/US20210312329A1/en
Priority to DE202021101389.3U priority patent/DE202021101389U1/de
Priority to CN202110359006.8A priority patent/CN113496421A/zh
Publication of FR3108995A3 publication Critical patent/FR3108995A3/fr
Application granted granted Critical
Publication of FR3108995B3 publication Critical patent/FR3108995B3/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0255—Targeted advertisements based on user history
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/20—Design optimisation, verification or simulation
    • G06F30/27—Design optimisation, verification or simulation using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201—Market modelling; Market analysis; Collecting market data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0254—Targeted advertisements based on statistics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0269—Targeted advertisements based on user profile or attribute
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0639—Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/14—Travel agencies
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/40—Business processes related to the transportation industry

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Databases & Information Systems (AREA)
  • Development Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Tourism & Hospitality (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Game Theory and Decision Science (AREA)
  • Computational Linguistics (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Probability & Statistics with Applications (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Un système mis en œuvre par ordinateur est fourni pour construire et adapter dynamiquement un site de recherche hébergé par un serveur web. Un module d'apprentissage renforcé est couplé au serveur web et utilise un modèle d'apprentissage renforcé pour contrôler l'apparence et/ou la fonctionnalité du site web de recherche en générant des actions à envoyer au serveur web. Ces actions ont trait au contrôle d'une liste ordonnée de recommandations de voyage obtenue comme résultat de la recherche, qui est affichée par le site web de recherche. Le module d’apprentissage de renforcement est adapté pour recevoir des récompenses, qui sont générées par le site web de recherche sur la base des entrées de l'utilisateur ou par un simulateur d'utilisateur du site web en réponse à une ou plusieurs des actions générées par le module d’apprentissage de renforcement. Les récompenses adaptent le modèle d’apprentissage de renforcement du module d'apprentissage de renforcement. Le simulateur d'utilisateur du site web simule un comportement de saisie de l'utilisateur et alimente le module d’apprentissage de renforcement pour former le module d’apprentissage de renforcement. Figure pour l’abrégé : Fig. 1
FR2003313A 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web Active FR3108995B3 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
FR2003313A FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web
US17/204,469 US20210312329A1 (en) 2020-04-02 2021-03-17 Reinforcement learning for website ergonomics
DE202021101389.3U DE202021101389U1 (de) 2020-04-02 2021-03-18 Reinforcement Learning für Webseiten-Ergonomie
CN202110359006.8A CN113496421A (zh) 2020-04-02 2021-04-02 用于网站人体工程学的强化学习

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2003313 2020-04-02
FR2003313A FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web

Publications (2)

Publication Number Publication Date
FR3108995A3 FR3108995A3 (fr) 2021-10-08
FR3108995B3 true FR3108995B3 (fr) 2022-04-01

Family

ID=76969002

Family Applications (1)

Application Number Title Priority Date Filing Date
FR2003313A Active FR3108995B3 (fr) 2020-04-02 2020-04-02 Apprentissage de renforcement pour l’ergonomie des sites Web

Country Status (4)

Country Link
US (1) US20210312329A1 (fr)
CN (1) CN113496421A (fr)
DE (1) DE202021101389U1 (fr)
FR (1) FR3108995B3 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114159828A (zh) * 2021-11-30 2022-03-11 高小红 一种超临界二氧化碳温控系统
CN114154416B (zh) * 2021-11-30 2025-07-08 中国电力科学研究院有限公司 一种配电网拓扑的控制方法、系统、设备及存储介质
CN115098906B (zh) * 2022-05-05 2023-04-07 哈尔滨工业大学 基于深度强化学习和系统可靠度的桥梁维修方法及系统
CN116630900B (zh) * 2023-07-21 2023-11-07 中铁第四勘察设计院集团有限公司 基于机器学习的客运站旅客流线识别方法、系统及设备
CN116966603B (zh) * 2023-09-22 2024-01-02 深圳云天畅想信息科技有限公司 云游戏多账户的托管方法、托管系统及计算机装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7010494B2 (en) * 2003-03-27 2006-03-07 University Of Washington Performing predictive pricing based on historical data
CN107688662B (zh) * 2017-09-08 2020-10-30 携程计算机技术（上海）有限公司 Ota酒店的推荐方法及系统
WO2019145952A1 (fr) * 2018-01-25 2019-08-01 Splitty Travel Ltd. Systèmes, procédés et produits programmes d'ordinateur pour l'optimisation de fonctions cibles de technologie de voyage, y compris lors de la communication avec des fournisseurs de technologie de voyage en cas de contraintes technologiques
EP3698283A1 (fr) * 2018-02-09 2020-08-26 DeepMind Technologies Limited Systèmes de réseau neuronal génératifs pour générer des séquences d'instructions pour commander un agent effectuant une tâche
US10909604B1 (en) * 2018-03-07 2021-02-02 Amazon Technologies, Inc. Artificial intelligence system for automated selection and presentation of informational content
CN110555748A (zh) * 2018-06-04 2019-12-10 阿里巴巴集团控股有限公司 业务对象的推荐方法、装置和旅行平台
US11238372B2 (en) * 2018-08-27 2022-02-01 Vmware, Inc. Simulator-training for automated reinforcement-learning-based application-managers

Also Published As

Publication number Publication date
CN113496421A (zh) 2021-10-12
DE202021101389U1 (de) 2021-07-05
FR3108995A3 (fr) 2021-10-08
US20210312329A1 (en) 2021-10-07

Similar Documents

Publication Publication Date Title
Arini et al. STUDENTS’PERCEPTION ON QUESTIONNING TECHNIQUE IN IMPROVING SPEAKING SKILL ABILITY AT ENGLISH EDUCATION STUDY PROGRAM
Mairesse et al. Towards personality-based user adaptation: psychologically informed stylistic language generation
Malele et al. The design thinking approach to students STEAM projects
Anttila et al. Organizational learning in developing the integrated quality management
KR20120061801A (ko) 언어 의사소통을 향상시키기 위한 방법 및 장치
EP4459517A3 (fr) Procédé d'apprentissage d'intentions personnalisées
Anastasiou et al. Evaluation of WikiTalk–user studies of human-robot interaction
WO2020122857A8 (fr) Systèmes et procédés permettant de fournir des réponses personnalisées avec un voculaire d'utilisateur appris pour des requêtes d'utilisateur
Mandanici et al. A computer-based approach to teach tonal harmony to young students
Smith et al. Assurance of learning: The role of work integrated learning and industry partners
Bauschard et al. Beyond Algorithmic Solutions: The Significance of Academic Debate for Learning Assessment and Skill Cultivation in the AI World
Hurtig et al. Modality fusion in a route navigation system
Adesina iNOUN: architecture and usability of a chatbot for academic enquiries
Aswathy et al. Voicyx: An Intelligent Voice Assistant Driven by the Llama-3.1-Nemotron-70B-Instruct AI Model
Choi et al. Teachers’ awareness and needs of the school-based speech-language pathologists
Messner Working in India
Curran Teaching software engineering in the computer science curriculum
Chellappan From Scripted Responses to Contextual Understanding: A Comprehensive Examination of Chatbot Technology and Its Journey Toward Mimicking Human Conversations
Domnin et al. “PENZA DIOCESAN JOURNAL” AS A HISTORICAL SOURCE FOR THE STUDY OF THE STATE AND THE RUSSIAN ORTHODOX CHURCH
Vijayaraghavan et al. CampusMaps: Voice Assisted Navigation Using Alexa Skills
Nokar Introduction to Nine Lessons for The Little Crooked House
Mandal et al. Vocal N Local: Audio News Platform for Regional Languages
Ho TA-bot: An AI agent as a Teaching Assistant. 4
Lapshova et al. Experience of Experimental Area Development in the System of Professional Education
White et al. Cloud Intelligent based Reference model for Voice-Interactive Application Suites

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

PLFP Fee payment

Year of fee payment: 5

PLFP Fee payment

Year of fee payment: 6

PLFP Fee payment

Year of fee payment: 7