WO2017143909A1 - 网页中的数据处理方法、装置及系统 - Google Patents

网页中的数据处理方法、装置及系统 Download PDF

Info

Publication number
WO2017143909A1
WO2017143909A1 PCT/CN2017/073136 CN2017073136W WO2017143909A1 WO 2017143909 A1 WO2017143909 A1 WO 2017143909A1 CN 2017073136 W CN2017073136 W CN 2017073136W WO 2017143909 A1 WO2017143909 A1 WO 2017143909A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
data set
synchronized
trigger signal
tag information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/073136
Other languages
English (en)
French (fr)
Inventor
朱宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to JP2018544539A priority Critical patent/JP6906540B2/ja
Priority to EP17755738.6A priority patent/EP3422210A4/en
Publication of WO2017143909A1 publication Critical patent/WO2017143909A1/zh
Priority to US16/109,291 priority patent/US20180365307A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/957—Browsing optimisation, e.g. caching or content distillation
    • G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/986—Document structures and storage, e.g. HTML extensions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Definitions

  • the present application relates to the field of webpage data processing technologies, and in particular, to a data processing method, apparatus, and system in a webpage.
  • a request is usually sent to the server by submitting a form; the server receives the request and processes the incoming form, and then returns a whole new web page.
  • the above webpage update method is to update all the code in the entire webpage. In the actual situation, most of the two pages before and after the update are the same, but only need to be updated locally. Therefore, the traditional way of updating the webpage does not need to update the code that needs to be updated, which is wasted. Many bandwidth resources.
  • Ajax Asynchronous JavaScript and XML
  • the Ajax technology can send an XML Http Request request to the server for the data to be synchronized locally on the page; correspondingly, the server parses the request and obtains corresponding backfill data to the page; the page backfills the backfill data accordingly, thereby completing Partial update of page data.
  • the purpose of the embodiments of the present application is to provide a data processing method, device, and system in a webpage, which realize self-management of data in a webpage, and can greatly reduce data maintenance cost and logic complexity.
  • the present invention provides a data processing method in a webpage, the method comprising: running a preset data set synchronization monitoring mode based on a trigger signal, and determining whether the data set needs to be synchronized according to a return result of the running data set synchronous monitoring mode; Obtaining tag information of the data set that needs to be synchronized; transmitting, under a preset condition, a data synchronization request for the data set corresponding to the tag information; receiving the data synchronization request, and acquiring corresponding to be synchronized based on the data synchronization request Data, and returning the data to be synchronized to the page; performing backfill processing on the corresponding data set by using the data to be synchronized.
  • the present invention provides a data processing method in a webpage, the method comprising: running a preset data set synchronization monitoring mode based on a trigger signal, and determining whether the data set needs to be synchronized according to a return result of the running data set synchronous monitoring mode; Obtaining tag information of the data set that needs to be synchronized; under a preset condition, transmitting a data synchronization request for the data set corresponding to the tag information.
  • the application provides a data processing device in a webpage, the device includes: a receiving module, configured to receive a trigger signal; and a status monitoring module, configured to run a preset data set synchronous monitoring mode based on the trigger signal;
  • the result of the data set synchronization monitoring method determines whether the data set needs to be synchronized;
  • the marking module is configured to obtain the marking information of the data set to be synchronized;
  • the request sending module is configured to, under the preset condition, correspond to the marking information
  • the data set sends a data synchronization request.
  • the present application provides a data processing system in a webpage, the system includes: a receiving module, configured to receive a trigger signal; and a status monitoring module, configured to run a preset data set synchronous monitoring mode based on the trigger signal;
  • the result of the data set synchronization monitoring method determines whether the data set needs to be synchronized;
  • the marking module is configured to obtain the marking information of the data set to be synchronized;
  • the request sending module is configured to, under the preset condition, correspond to the marking information
  • the data set sends a data synchronization request;
  • the request processing module is configured to receive the data synchronization request, acquire corresponding data to be synchronized based on the data synchronization request, and return the data to be synchronized to the page; and backfill the module for utilizing The data to be synchronized is backfilled to the corresponding data set.
  • the data set needs to be synchronized according to the returned result of the synchronized monitoring mode of the data set, and the tag information of the data set that needs to be synchronized is acquired; further Synchronizing the data set and performing partial update of the page data for a data synchronization request.
  • it can determine whether synchronization is needed according to the predetermined identifier, when to send the data synchronization request, and can synchronize according to the data.
  • the request completes the synchronization of the specified data set, thereby realizing the self-management of the data and reducing the maintenance cost of the data; in particular, when the data set to be synchronized is requested for one data synchronization, the number of data synchronization requests is greatly reduced, and The logic complexity of data maintenance is greatly reduced; at the same time, when the request is merged, the number of requests is greatly reduced, thereby reducing the overall time spent on network transmission and improving page performance.
  • FIG. 1 is a flowchart of a data processing method in a webpage according to an embodiment of the present application
  • FIG. 2 is a flowchart of a data processing method in a webpage according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of a data processing apparatus in a webpage according to an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of a data processing system in a webpage according to an embodiment of the present application.
  • FIG. 1 is a flowchart of a data processing method in a webpage provided by an embodiment of the present application.
  • the present application provides method operational steps or apparatus structures as shown in the following embodiments or figures, more or fewer operational steps or modular structures may be included in the method or apparatus based on conventional or no inventive labor. .
  • the execution order of the steps or the module structure of the device is not limited to the execution order or module structure provided by the embodiments of the present application.
  • the actual device or terminal product of the method or module structure is executed, it may be sequentially executed or executed in parallel according to the method or the module structure shown in the embodiment or the drawing (for example, parallel processor or multi-thread processing). surroundings).
  • a data processing method in a webpage provided by an embodiment of the present application may include the following steps.
  • Step S10 Run a preset data set synchronization monitoring mode based on the trigger signal, and determine whether the data set needs to be synchronized according to the returned result of the running data set synchronous monitoring mode.
  • the page contains data, which may be the content to be displayed on the page.
  • page data may be the content to be displayed on the page.
  • page data The content may be different according to actual business needs, for example, may include characters, pictures, tables, animations, and the like, and the present application is not specifically limited herein.
  • the page data may be divided based on a predetermined dividing rule, thereby dividing the page data into a data set having a preset data parsing format.
  • the predetermined dividing rule may be to divide the page data into multiple data sets according to an actual service dimension.
  • the page data can be divided into: basic data set, project data set, process to-do list (to do) according to the dimension of the business. Data sets, code branch information (repo) data sets, development server information (server) data sets, and so on.
  • the predetermined division rule is not limited to the above description, and other changes may be made by those skilled in the art in light of the technical essence of the present application, but as long as the functions and effects thereof are the same or similar to the present application, All should be covered by the scope of this application.
  • each data set may have a preset data parsing format.
  • the preset data parsing format may be a complete set containing a complete description and parsing of the current state.
  • its data parsing format may include server name, phase information, status information, and the like.
  • the state information in the data parsing format may be used to indicate the state of parsing the data set, and other information may be used to cooperate with other attributes describing the data set.
  • the preset data parsing format is not limited to the above description, and other changes may be made by those skilled in the art in light of the technical essence of the present application, but the functions and effects thereof are the same as or similar to the present application. All should be covered by the scope of this application.
  • the returned result may be a predetermined identifier used to indicate whether the data set needs to be synchronized.
  • the predetermined identifier may include a first identifier and a second identifier.
  • the first identifier may be used to indicate that the state of the corresponding data set is a state to be synchronized; the second identifier may be used to indicate that the corresponding data set is in a stable state, and synchronization is not required.
  • the specific form of the predetermined identifier may be the number 1, 0, and may be the characters "true", "false", etc., and the present application is not specifically limited herein.
  • the preset data set synchronization monitoring manner may be configured to have an interface that can be called for each data set.
  • the interface may be an object-oriented interface that is internally encapsulated with logic for determining the state of the corresponding data set.
  • the interface can determine whether the specific state of the data set is stable or unstable. When the data set is in a steady state, it indicates that the data set does not currently need to be synchronized; when the data set is in an unstable state, it indicates that the data set currently needs to synchronize data.
  • the peripheral calls the interface, the corresponding Boolean value can be fed back to the periphery.
  • the interface is in determining that the data set is If synchronization is required, the status information of the data set may be compared with the preset information stored therein to determine whether the status information meets the synchronization requirement of the data set.
  • the status information of the preset information and the data set may be changed according to the actual service and the change of the scenario.
  • the application is not specifically limited herein. Taking the server data set as an example, the preset information may be “no data obtained”, “deployed”, or “allocated”.
  • the status information is one of the preset information, it may be determined that the data set meets the synchronization requirement of the data set, and the corresponding return "true"; when the status information does not match the preset information Then, it can be determined that the data set does not meet the synchronization requirement of the data set, and the corresponding return "false".
  • the predetermined identification of each data set in the page may be monitored according to the trigger signal to determine whether each of the data sets needs to be synchronized.
  • the trigger signal may specifically be a periodic trigger signal.
  • a periodic monitoring module can be set in the page. Each data set is correspondingly provided with the interface. The periodic monitoring module may automatically invoke an interface corresponding to each data set in a predetermined period. Upon invocation, the interface returns, to its monitoring module, a predetermined identification indicating the status of the data set for its respective data set.
  • the trigger signal may also be a designated trigger signal.
  • a corresponding function button is set in the page. When the user clicks the function button according to actual needs, a trigger signal may be sent to drive the corresponding monitoring module to call the interface corresponding to each data set to obtain a corresponding Scheduled logo.
  • Step S12 Acquire tag information of the data set that needs to be synchronized.
  • the data set may be marked to obtain a tag information of the data set with the state of being in a state to be synchronized.
  • the tag information is used to uniquely represent the data set that needs to be synchronized.
  • the tag information may be a name of the data set, a number set according to a predetermined rule, or the like.
  • Step S14 Send a data synchronization request for the data set corresponding to the tag information under a preset condition.
  • the preset condition may be that the first marker information is obtained and reaches a predetermined duration; or the number of marker information reaches a predetermined number; or the specified transmission signal is received, or a plurality of the foregoing conditions
  • the combinations and the like are not specifically limited herein.
  • a periodic monitoring module such as a timer, may be disposed in the page.
  • the module monitors the predetermined identifier that the data set needs to be synchronized, and when the tag information of the data set is obtained correspondingly, the first tag information may be obtained, and when the predetermined duration is reached, the tag information is The corresponding data set sends a data synchronization request.
  • the predetermined duration may be set according to actual service requirements, for example, 1 second, 3 seconds, 5 seconds, etc., and the present application is not specifically limited herein.
  • the periodic monitoring module can also have a counting function.
  • it may count the tag information, and when the number of tag information reaches a predetermined number, send a data synchronization request for the data set corresponding to the tag information.
  • the predetermined number may be set according to actual service requirements, for example, may be three, five, seven, etc., and the present application is not specifically limited herein.
  • a corresponding send button may also be provided in the page, and when the send button is clicked, the specified send signal may be triggered. After the corresponding request sending module receives the sending signal, a data synchronization request may be sent to the data set corresponding to the tag information.
  • the data synchronization request may be an Ajax request, and the data communication between the browser and the server may be implemented by using other technologies such as a websocket and a long link.
  • the application is not specifically limited herein.
  • the data synchronization request may include parsing parameters corresponding to the data set, for example, tag information of the data set, content that the data set specifically needs to be synchronized, and the like.
  • the data synchronization request may further include address information of the processing server for accurately transmitting a data synchronization request thereto.
  • Step S16 Receive the data synchronization request, acquire corresponding data to be synchronized based on the data synchronization request, and return the data to be synchronized to the page.
  • the data synchronization request may be sent to a predetermined processing server.
  • the predetermined processing server receives the data synchronization request
  • the data synchronization request may be parsed first to obtain a corresponding resolution. parameter.
  • the parsing parameter may include tag information of the data set to be synchronized, where the data set specifically needs to be synchronized data content, address information corresponding to the page end, and the like.
  • the processing server After the processing server completes the parsing of the data synchronization request, based on the parsed parameters, the data to be synchronized required by the data set may be acquired. Specifically, the data to be synchronized may be obtained from a local database, may be obtained from an interface of another system, or may be obtained by the processing server after multiple queries. The application is not specifically limited herein. After the processing server acquires the data to be synchronized required by the data set, the data to be synchronized may be returned to the page.
  • Step S18 Perform backfill processing on the corresponding data set by using the to-be-synchronized data.
  • the corresponding data can be used to refill the module.
  • Block performing corresponding backfill processing on the data to be synchronized.
  • the data set to be synchronized may be accompanied by tag information during request synchronization, processing server acquisition data, and page backfill processing, so as to ensure that multiple data sets are updated synchronously, and finally can be accurately backfilled in place.
  • the data set needs to be synchronized according to the returned result of the synchronized monitoring mode of the data set, and the tag information of the data set that needs to be synchronized is obtained, and the data set that needs to be synchronized is further combined into one data.
  • the synchronization request performs partial update of the page data.
  • the number of data synchronization requests is greatly reduced, the logic complexity of data maintenance can be greatly reduced, and the number of http requests can be greatly reduced when the request is merged. Therefore, the overall time spent on the network transmission is reduced. Accordingly, the number of times of dns routing and the like, and the number of tcp handshakes are correspondingly small, so that the page performance can be improved.
  • the following describes an implementation manner of a data processing method in a webpage with the page end as the main body.
  • a data processing method in a webpage provided by an embodiment of the present application may include the following steps.
  • Step S10 Run a preset data set synchronization monitoring mode based on the trigger signal, and determine whether the data set needs to be synchronized according to the returned result of the running data set synchronous monitoring mode.
  • the page contains data, which may be the content to be displayed on the page.
  • data may be the content to be displayed on the page.
  • the content of the page data may be different according to actual business requirements, for example, characters, pictures, tables, animations, and the like, which are not specifically limited herein.
  • the page data may be divided based on a predetermined dividing rule, thereby dividing the page data into a data set having a preset data parsing format.
  • the predetermined dividing rule may be to divide the page data into multiple data sets according to an actual service dimension.
  • the page data can be divided into: basic data set, project data set, process to-do list (to do) according to the dimension of the business. Data sets, code branch information (repo) data sets, development server information (server) data sets, and so on.
  • the predetermined division rule is not limited to the above description, and other changes may be made by those skilled in the art in light of the technical essence of the present application, but as long as the functions and effects thereof are the same or similar to the present application, All should be covered by the scope of this application.
  • each data set may have a preset data parsing format.
  • the preset data parsing format Can contain a complete set that can fully describe and parse the current state.
  • its data parsing format may include server name, phase information, status information, and the like.
  • the state information in the data parsing format may be used to indicate the state of parsing the data set, and other information may be used to cooperate with other attributes describing the data set.
  • the preset data parsing format is not limited to the above description, and other changes may be made by those skilled in the art in light of the technical essence of the present application, but the functions and effects thereof are the same as or similar to the present application. All should be covered by the scope of this application.
  • the returned result may be a predetermined identifier used to indicate whether the data set needs to be synchronized.
  • the predetermined identifier may include a first identifier and a second identifier.
  • the first identifier may be used to indicate that the state of the corresponding data set is a state to be synchronized; the second identifier may be used to indicate that the corresponding data set is in a stable state, and synchronization is not required.
  • the specific form of the predetermined identifier may be the number 1, 0, and may be the characters "true", "false", etc., and the present application is not specifically limited herein.
  • the preset data set synchronization monitoring manner may be configured to have an interface that can be called for each data set.
  • the interface may be an object-oriented interface that is internally encapsulated with logic for determining the state of the corresponding data set.
  • the interface can determine whether the specific state of the data set is stable or unstable. When the data set is in a steady state, it indicates that the data set does not currently need to be synchronized; when the data set is in an unstable state, it indicates that the data set currently needs to synchronize data.
  • the peripheral calls the interface, the corresponding Boolean value can be fed back to the periphery.
  • the interface may compare the state information of the data set with the preset information stored therein to determine whether the state information meets the synchronization requirement of the data set.
  • the status information of the preset information and the data set may be changed according to the actual service and the change of the scenario.
  • the application is not specifically limited herein. Taking the server data set as an example, the preset information may be “no data obtained”, “deployed”, or “allocated”.
  • the status information is one of the preset information, it may be determined that the data set meets the synchronization requirement of the data set, and the corresponding return "true"; when the status information does not match the preset information Then, it can be determined that the data set does not meet the synchronization requirement of the data set, and the corresponding return "false".
  • the predetermined identification of each data set in the page may be monitored according to the trigger signal to determine whether each of the data sets needs to be synchronized.
  • the trigger signal may specifically be a periodic trigger signal.
  • a periodic monitoring module can be set in the page. Each data set is correspondingly provided with the interface. The periodic monitoring module may automatically invoke the corresponding connection of each data set in a predetermined cycle. mouth. Upon invocation, the interface returns, to its monitoring module, a predetermined identification indicating the status of the data set for its respective data set.
  • the trigger signal may also be a designated trigger signal.
  • a corresponding function button is set in the page. When the user clicks the function button according to actual needs, a trigger signal may be sent to drive the corresponding monitoring module to call the interface corresponding to each data set to obtain a corresponding Scheduled logo.
  • Step S12 Acquire tag information of the data set that needs to be synchronized.
  • the data set may be marked to obtain a tag information of the data set with the state of being in a state to be synchronized.
  • the tag information is used to uniquely represent the data set that needs to be synchronized.
  • the tag information may be a name of the data set, a number set according to a predetermined rule, or the like.
  • Step S14 Send a data synchronization request for the data set corresponding to the tag information under a preset condition.
  • the preset condition may be that the first marker information is obtained and reaches a predetermined duration; or the number of marker information reaches a predetermined number; or the specified transmission signal is received, or a plurality of the foregoing conditions
  • the combinations and the like are not specifically limited herein.
  • a periodic monitoring module such as a timer
  • the periodic monitoring module detects that there is a predetermined identifier that the data set needs to be synchronized, and correspondingly obtains the marking information of the data set
  • the first marking information may be obtained from the time when the predetermined time is obtained, and the predetermined time length is reached.
  • the data set corresponding to the tag information transmits a data synchronization request.
  • the predetermined duration may be set according to actual service requirements, for example, 1 second, 3 seconds, 5 seconds, etc., and the present application is not specifically limited herein.
  • the periodic monitoring module can also have a counting function.
  • it may count the tag information, and when the number of tag information reaches a predetermined number, send a data synchronization request for the data set corresponding to the tag information.
  • the predetermined number may be set according to actual service requirements, for example, may be three, five, seven, etc., and the present application is not specifically limited herein.
  • a corresponding send button may also be provided in the page, and when the send button is clicked, the specified send signal may be triggered. After the corresponding request sending module receives the sending signal, a data synchronization request may be sent to the data set corresponding to the tag information.
  • the data synchronization request may specifically be an Ajax request, and may also be used. Other technical methods such as websocket and long link implement data communication between the browser and the server, and the present application is not specifically limited herein.
  • the data synchronization request may include parsing parameters corresponding to the data set, for example, tag information of the data set, content that the data set specifically needs to be synchronized, and the like.
  • the data synchronization request may further include address information of the processing server for accurately transmitting a data synchronization request thereto.
  • the data set that needs to be synchronized is determined whether the data set needs to be synchronized according to the returned result of the running data set synchronization monitoring manner, and acquiring the marking information of the data set that needs to be synchronized; further, the data set that needs to be synchronized is combined into one data.
  • the synchronization request performs partial update of the page data.
  • the synchronization of the page data set it can determine whether synchronization is needed according to the predetermined identifier, and when the data synchronization request is sent, realizing self-management of data and reducing data maintenance cost; Yes, when the data set to be synchronized is requested for one data synchronization, the number of data synchronization requests is greatly reduced, the logic complexity of data maintenance can be greatly reduced, and the number of http requests can be greatly reduced when the request is merged. Therefore, the overall time spent on the network transmission is reduced. Correspondingly, the number of times of dns routing and the like, and the number of tcp handshakes are correspondingly small, so that the page performance can also be improved.
  • the present application further provides a data processing apparatus in a webpage.
  • the data processing apparatus in the webpage may include:
  • the receiving module 11 is configured to receive a trigger signal
  • the status monitoring module 13 is configured to run a preset data set synchronization monitoring mode based on the trigger signal; and determine whether the data set needs to be synchronized according to the returned result of the running data set synchronous monitoring mode;
  • a marking module 15 configured to acquire tag information of a data set that needs to be synchronized
  • the request sending module 17 is configured to send a data synchronization request for the data set corresponding to the tag information under a preset condition.
  • the preset condition may include at least one of the following:
  • the number of tag information reaches a predetermined number.
  • the trigger signal includes one of a specified trigger signal and a periodic trigger signal.
  • the data processing device in the webpage disclosed in the above embodiment corresponds to the data processing method embodiment in the webpage of the present application, and the data processing method implementation manner in the webpage of the present application can be implemented and the technology of the method implementation manner can be achieved. Effect.
  • the present application further provides a data processing system in a webpage.
  • the data processing system in the webpage may include:
  • the receiving module 11 is configured to receive a trigger signal
  • the status monitoring module 13 is configured to run a preset data set synchronization monitoring mode based on the trigger signal; and determine whether the data set needs to be synchronized according to the returned result of the running data set synchronous monitoring mode;
  • a marking module 15 configured to acquire tag information of a data set that needs to be synchronized
  • the request sending module 17 is configured to send a data synchronization request for the data set corresponding to the tag information under a preset condition.
  • the request processing module 19 is configured to receive the data synchronization request, acquire corresponding data to be synchronized based on the data synchronization request, and return the to-be-synchronized data to the page;
  • the backfilling module 21 is configured to perform backfill processing on the corresponding data set by using the to-be-synchronized data.
  • the data processing system in the webpage disclosed in the above embodiment corresponds to the data processing method embodiment in the webpage of the present application, and the data processing method embodiment in the webpage of the present application can be implemented and the technical effect of the method embodiment can be achieved.
  • the apparatus or module illustrated in the above embodiments may be implemented by a computer chip or an entity, or may have A product of a certain function is implemented.
  • the above devices are described as being separately divided into various modules by function.
  • the functions of the various modules may be implemented in one or more software and/or hardware in the implementation of the present application.
  • the controller can take, for example, a microprocessor or processor and storage can be processed by the (micro) Computer readable medium (eg, software or firmware) executed by a computer readable medium, logic gate, switch, Application Specific Integrated Circuit (ASIC), programmable logic controller, and embedded microcontroller,
  • microcontrollers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, which may also be implemented as part of the control logic of the memory.
  • the controller can be logically programmed by means of logic gates, switches, ASICs, programmable logic controllers, and embedding.
  • modules in the apparatus described herein may be described in the general context of computer-executable instructions executed by a computer, such as program modules.
  • program modules include routines, programs, objects, components, data structures, classes, and the like that perform particular tasks or implement particular abstract data types.
  • the present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network.
  • program modules can be located in both local and remote computer storage media including storage devices.
  • the present application can be implemented by means of software plus necessary hardware. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product in essence or in the form of a software product, or may be embodied in the implementation process of data migration.
  • the computer software product may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions for causing a computer device (which may be a personal computer, a mobile terminal, a server, or a network device) to execute the present application.
  • a computer device which may be a personal computer, a mobile terminal, a server, or a network device

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种网页中的数据处理方法、装置及系统。所述方法包括：基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步（S10）；获取需要同步的数据集的标记信息（S12）；在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求（S14）；接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面（S16）；利用所述待同步数据对相应的数据集进行回填处理（S18）。所述网页中的数据处理方法、装置及系统，实现了网页中数据的自管理，能够大大降低数据的维护成本和逻辑复杂度。

Description

网页中的数据处理方法、装置及系统
本申请要求2016年02月23日递交的申请号为201610098831.6、发明名称为“网页中的数据处理方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及网页数据处理技术领域，特别涉及一种网页中的数据处理方法、装置及系统。
背景技术
传统的网页更新时，通常是通过提交表单的方式向服务器发送一个请求；服务器接收请求并处理传来的表单，然后返回一整个新的网页。上述网页更新方式是对整个网页中所有的代码都进行了更新。而实际情况中，往往更新前和更新后的两个页面大部分代码是相同的，只是局部需要更新而已，因此，传统的网页更新方式对不需要更新的代码进行了不必要的更新，浪费了许多带宽资源。
目前随着前端技术的发展，页面多用Ajax(Asynchronous JavaScript and XML)即(异步的JavaScript和XML)技术。Ajax技术可以针对页面局部待同步的数据，向服务器发送XML Http Request请求；相应地，服务器解析所述请求，并获取相应的回填数据给页面；页面将所述回填数据相应的回填，从而完成了页面数据的局部更新。
在一个实际应用场景中，首先需要判断页面具体哪个数据块需要同步，然后针对该数据利用所述Ajax技术进行数据更新时，通常是需要编写一个Ajax程序，向远程服务器发送Ajax数据同步请求去请求数据，服务器再将请求获取的数据返回页面，页面解析数据完成回填后，页面更新才能完成。然而当页面多个不同的区块同时需要同步时，针对每个区块需要分别进行页面数据的请求、处理、回填等操作。在实际情况中，在多个区块出现数据同步的并发请求时，同时维护每个待同步区块对应建立的页面数据的请求、处理、回填链路的维护成本和逻辑复杂度非常高。
发明内容
本申请实施方式的目的是提供一种网页中的数据处理方法、装置及系统，实现了网页中数据的自管理，能够大大降低数据的维护成本和逻辑复杂度。
本申请提供一种网页中的数据处理方法，所述方法包括：基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；获取需要同步的数据集的标记信息；在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求；接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面；利用所述待同步数据对相应的数据集进行回填处理。
本申请提供一种网页中的数据处理方法，所述方法包括：基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；获取需要同步的数据集的标记信息；在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
本申请提供一种网页中的数据处理装置，所述装置包括：接收模块，用于接收触发信号；状态监测模块，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；标记模块，用于获取需要同步的数据集的标记信息；请求发送模块，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
本申请提供一种网页中的数据处理系统，所述系统包括：接收模块，用于接收触发信号；状态监测模块，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；标记模块，用于获取需要同步的数据集的标记信息；请求发送模块，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求；请求处理模块，用于接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面；回填模块，用于利用所述待同步数据对相应的数据集进行回填处理。
由以上描述的本实施方式所提供的技术方案可见，通过根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步，并获取需要同步的数据集的标记信息；进一步的将需要同步的数据集合并为一个数据同步请求进行页面数据的局部更新，整个页面数据集同步过程中，能够根据所述预定标识判断是否需要同步，何时发送数据同步请求，以及能够按照所述数据同步请求完成指定数据集的同步，从而实现了数据的自管理，降低数据的维护成本；特别是，当将需要同步的数据集合并为一个数据同步请求后，大大减少了数据同步请求的数量，能够大大降低数据维护的逻辑复杂度；同时当请求合并后，大大减少了请求个数，从而减少耗在网络传输上的总体时间，能提高页面性能。
附图说明
为了更清楚地说明本申请实施方式或现有技术中的技术方案，下面将对实施方式或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请中记载的一些实施方式，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本申请一个实施方式提供的网页中的数据处理方法的流程图；
图2为本申请一个实施方式提供的网页中的数据处理方法的流程图；
图3为本申请一个实施方式提供的网页中的数据处理装置的示意图；
图4为本申请一个实施方式提供的网页中的数据处理系统的示意图。
具体实施方式
为了使本技术领域的人员更好地理解本申请中的技术方案，下面将结合本申请实施方式中的附图，对本申请实施方式中的技术方案进行清楚、完整地描述，显然，所描述的实施方式仅仅是本申请一部分实施方式，而不是全部的实施方式。基于本申请中的实施方式，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施方式，都应当属于本申请保护的范围。
下面结合附图对本申请所述的网页中的数据处理方法、装置及系统进行详细的说明。图1是本申请一个实施方式提供的网页中的数据处理方法的流程图。虽然本申请提供了如下述实施方式或附图所示的方法操作步骤或装置结构，但基于常规或者无需创造性的劳动在所述方法或装置中可以包括更多或者更少的操作步骤或模块结构。在逻辑性上不存在必要因果关系的步骤或结构中，这些步骤的执行顺序或装置的模块结构不限于本申请实施方式提供的执行顺序或模块结构。所述的方法或模块结构的在实际中的装置或终端产品执行时，可以按照实施方式或者附图所示的方法或模块结构连接进行顺序执行或者并行执行(例如并行处理器或者多线程处理的环境)。
请参阅图1，本申请一个实施方式所提供的一种网页中的数据处理方法可以包括如下步骤。
步骤S10：基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步。
一般的，页面中包含有数据，所述数据可为页面待展示的内容。具体的，页面数据 的内容可以根据实际业务需求的不同而不同，例如，可以包括：字符、图片、表格、动画等等，本申请在此并不作具体的限定。
在本实施方式中，可以基于预定的划分规则对所述页面数据进行划分，从而将所述页面数据划分为具有预设数据解析格式的数据集。具体的，所述预定的划分规则可为根据实际的业务维度，将页面数据划分为多个数据集。例如，当实际的业务为一个研发流程系统时，页面数据按照业务的维度，可以划分为：项目基本信息(basic)数据集、项目阶段信息(process)数据集、阶段的待办事项(to do)数据集、代码分支信息(repo)数据集、开发服务器信息(server)数据集等。当然，所述预定的划分规则并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
在本实施方式中，每个数据集可以具有预设数据解析格式。所述预设数据解析格式可以为包含能完整描述和解析当前状态的全集。例如，对于server数据集而言，其数据解析格式可包含服务器名字、阶段信息、状态信息等。其中，所述数据解析格式中的状态信息可以用于表示解析所述数据集的状态，其他信息可以用于配合描述所述数据集的其他属性。当然，所述预设数据解析格式并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
在本实施方式中，针对每个数据集通过运行预设的数据集同步监测方式，可以获取相应的返回结果。具体的，所述返回结果可以为用于表示所述数据集是否需要同步的预定标识。具体的，所述预定标识可以包括第一标识和第二标识。所述第一标识可以用于表示相应的数据集的状态为待同步状态；所述第二标识可以用于表示相应的数据集为稳定状态，不需要同步。所述预定标识的具体形式可以为数字1、0，可以为字符“true”、“false”等等，本申请在此并不作具体的限定。
在一个具体的实施方式中，所述预设的数据集同步监测方式可以为针对每个数据集设置有可被调用的接口。所述接口可以为面向对象方式的接口，其内部封装有用于判断相应数据集状态的逻辑。所述接口能够判断数据集的具体状态为稳定态还是不稳定状态。当数据集为稳定态时，表明所述数据集当前不需要同步；当所述数据集为不稳定状态时，表明所述数据集当前需要同步数据。当外围调用所述接口时，可以向外围反馈相应的布尔值。当所述布尔值为“false”时，表明当前数据集为稳定态不用同步；当所述布尔值为“true”时，表明当前数据集为不稳定态，需要同步。其中，所述接口在判断数据集是 否需要同步时，可以将数据集的状态信息与其内部存储的预设信息进行比对，判断所述状态信息是否符合数据集的同步要求。其中，所述预设信息和数据集的状态信息可以根据实际的业务、场景的变化而变化，本申请在此并不作具体的限定。以server数据集为例，所述预设信息可以为“没拿到数据”，“部署中”，或者“分配中”。而当所述状态信息为上述预设信息中的一个时，则可以判断出所述数据集符合数据集的同步要求，相应的返回“true”；当所述状态信息与上述预设信息不匹配时，则可以判断出所述数据集不符合数据集的同步要求，相应的返回“false”。
在本实施方式中，可以根据触发信号监测页面中的每个数据集的预定标识，从而确定所述每个数据集是否需要同步。在一个具体的实施方式中，所述触发信号具体可以为周期性触发信号。例如，在页面中可以设置有周期性监测模块。每个数据集对应设置有所述接口。所述周期性监测模块可以以预定的周期，自动调用所述每个数据集对应的接口。调用时，所述接口针对其相应的数据集，向所述监测模块返回用于表示所述数据集状态的预定标识。此外，在另一个具体的实施方式中，所述触发信号也可以为指定触发信号。例如，在所述页面中设置有相应的功能按钮，当用户根据实际需要点击所述功能按钮时，可以发出触发信号，驱动相应的监测模块调用所述每个数据集对应的接口，获取相应的预定标识。
步骤S12：获取需要同步的数据集的标记信息。
在本实施方式中，当监测到具体需要同步的数据集之后，可以将所述数据集进行标记，获得一个与所述状态为待同步状态的数据集的标记信息。所述标记信息用于唯一表示所述需要同步的数据集。具体的，所述标记信息可以为所述数据集的名称，也可以为按照预定规则设置的编号等等。当然，所述标记信息的具体形式并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
步骤S14：在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
在本实施方式中，所述预设条件可以为获得第一个标记信息起，且达到预定时长；或者标记信息个数达到预定的数量；或者接收到指定的发送信号，或者上述条件中的多个组合等，本申请在此并不作具体的限定。
具体的，在页面中可以设置有周期性监测模块，例如定时器等。当所述周期性监测 模块监测到有数据集需要同步的预定标识，同时相应的获得了所述数据集的标记信息时，可以自获得第一个标记信息起，至达到预定时长时，针对所述与所述标记信息相对应的数据集发送数据同步请求。所述预定时长，可以根据实际业务需求进行设定，例如可以为1秒、3秒、5秒等等，本申请在此并不作具体的限定。此外，所述周期性监测模块也可以有计数功能。例如，其可以对所述标记信息进行计数，当所述标记信息的个数达到预定的个数时，针对与所述标记信息相对应的数据集发送数据同步请求。所述预定的个数也可以根据实际业务需求进行设定，例如可以为3个、5个、7个等等，本申请在此并不作具体的限定。当然，在所述页面中也可以设置有相应的发送按钮，当点击所述发送按钮时，可以触发指定的发送信号。当相应的请求发送模块接收到所述发送信号后，可以对与所述标记信息相对应的数据集发送数据同步请求。
在本实施方式中，所述数据同步请求具体的可以为Ajax请求，此外还可以用websocket，长链接等其他技术方式实现浏览器和服务器的数据通信，本申请在此并不作具体的限定。在所述数据同步请求中可以包含有与所述数据集相对应的解析参数，例如，所述数据集的标记信息以及所述数据集具体需要同步的内容等。此外，所述数据同步请求还可以包含有处理服务器的地址信息，用于准确地向其发送数据同步请求。
步骤S16：接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面。
在本实施方式中，所述数据同步请求可以向预定的处理服务器发送，当所述预定的处理服务器接收到所述数据同步请求时，可以先对所述数据同步请求进行解析，获得相应的解析参数。其中，所述解析参数可以包括待同步数据集的标记信息，所述数据集具体需要同步的数据内容，页面端对应的地址信息等。
当所述处理服务器完成所述数据同步请求的解析后，基于所述解析获得的参数，可以获取所述数据集所需的待同步数据。具体的，所述待同步的数据可能从本地数据库中获取，可能从其他系统的接口中获取，也可能需要所述处理服务器进行多次查询后获得，本申请在此并不作具体的限定。当所述处理服务器获取所述数据集所需的待同步数据后，可以将所述待同步数据返回所述页面。
步骤S18：利用所述待同步数据对相应的数据集进行回填处理。
在本实施方式中，当页面端接收到所述待同步数据后，可以利用相应的数据回填模 块，对所述待同步数据进行相应的回填处理。所述待同步的数据集在请求同步、处理服务器获取数据、页面回填处理过程中可以附带有标记信息，从而保证多个数据集同步更新时，最后都能准确回填到位。
本申请实施方式中，通过根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步，并获取需要同步的数据集的标记信息，进一步的将需要同步的数据集合并为一个数据同步请求进行页面数据的局部更新，整个页面数据集同步过程中，能够根据所述预定标识判断是否需要同步，何时发送数据同步请求，以及能够按照所述数据同步请求完成指定数据集的同步，从而实现了数据的自管理，降低数据的维护成本。特别是，当将需要同步的数据集合并为一个数据同步请求后，大大减少了数据同步请求的数量，能够大大降低数据维护的逻辑复杂度，同时当请求合并后，可大大减少http请求个数，从而减少耗在网络传输上的总体时间，相应地，dns路由等的解析次数，tcp握手次数也会相应较少，因此能提高页面性能。
下面介绍本申请以页面端为主体的一种网页中的数据处理方法的实施方式。
请参阅图2，本申请一个实施方式提供的网页中的数据处理处理方法可以包括如下步骤。
步骤S10：基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步。
一般的，页面中包含有数据，所述数据可为页面待展示的内容。具体的，页面数据的内容可以根据实际业务需求的不同而不同，例如，可以包括：字符、图片、表格、动画等等，本申请在此并不作具体的限定。
在本实施方式中，可以基于预定的划分规则对所述页面数据进行划分，从而将所述页面数据划分为具有预设数据解析格式的数据集。具体的，所述预定的划分规则可为根据实际的业务维度，将页面数据划分为多个数据集。例如，当实际的业务为一个研发流程系统时，页面数据按照业务的维度，可以划分为：项目基本信息(basic)数据集、项目阶段信息(process)数据集、阶段的待办事项(to do)数据集、代码分支信息(repo)数据集、开发服务器信息(server)数据集等。当然，所述预定的划分规则并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
在本实施方式中，每个数据集可以具有预设数据解析格式。所述预设数据解析格式 可以为包含能完整描述和解析当前状态的全集。例如，对于server数据集而言，其数据解析格式可包含服务器名字、阶段信息、状态信息等。其中，所述数据解析格式中的状态信息可以用于表示解析所述数据集的状态，其他信息可以用于配合描述所述数据集的其他属性。当然，所述预设数据解析格式并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
在本实施方式中，针对每个数据集通过运行预设的数据集同步监测方式，可以获取相应的返回结果。具体的，所述返回结果可以为用于表示所述数据集是否需要同步的预定标识。具体的，所述预定标识可以包括第一标识和第二标识。所述第一标识可以用于表示相应的数据集的状态为待同步状态；所述第二标识可以用于表示相应的数据集为稳定状态，不需要同步。所述预定标识的具体形式可以为数字1、0，可以为字符“true”、“false”等等，本申请在此并不作具体的限定。
在一个具体的实施方式中，所述预设的数据集同步监测方式可以为针对每个数据集可以设置有可被调用的接口。所述接口可以为面向对象方式的接口，其内部封装有用于判断相应数据集状态的逻辑。所述接口能够判断数据集的具体状态为稳定态还是不稳定状态。当数据集为稳定态时，表明所述数据集当前不需要同步；当所述数据集为不稳定状态时，表明所述数据集当前需要同步数据。当外围调用所述接口时，可以向外围反馈相应的布尔值。当所述布尔值为“false”时，表明当前数据集为稳定态不用同步；当所述布尔值为“true”时，表明当前数据集为不稳定态，需要同步。其中，所述接口在判断数据集是否需要同步时，可以将数据集的状态信息与其内部存储的预设信息进行比对，判断所述状态信息是否符合数据集的同步要求。其中，所述预设信息和数据集的状态信息可以根据实际的业务、场景的变化而变化，本申请在此并不作具体的限定。以server数据集为例，所述预设信息可以为“没拿到数据”，“部署中”，或者“分配中”。而当所述状态信息为上述预设信息中的一个时，则可以判断出所述数据集符合数据集的同步要求，相应的返回“true”；当所述状态信息与上述预设信息不匹配时，则可以判断出所述数据集不符合数据集的同步要求，相应的返回“false”。
在本实施方式中，可以根据触发信号监测页面中的每个数据集的预定标识，从而确定所述每个数据集是否需要同步。在一个具体的实施方式中，所述触发信号具体可以为周期性触发信号。例如，在页面中可以设置有周期性监测模块。每个数据集对应设置有所述接口。所述周期性监测模块可以以预定的周期，自动调用所述每个数据集对应的接 口。调用时，所述接口针对其相应的数据集，向所述监测模块返回用于表示所述数据集状态的预定标识。此外，在另一个具体的实施方式中，所述触发信号也可以为指定触发信号。例如，在所述页面中设置有相应的功能按钮，当用户根据实际需要点击所述功能按钮时，可以发出触发信号，驱动相应的监测模块调用所述每个数据集对应的接口，获取相应的预定标识。
步骤S12：获取需要同步的数据集的标记信息。
在本实施方式中，当监测到具体需要同步的数据集之后，可以将所述数据集进行标记，获得一个与所述状态为待同步状态的数据集的标记信息。所述标记信息用于唯一表示所述需要同步的数据集。具体的，所述标记信息可以为所述数据集的名称，也可以为按照预定规则设置的编号等等。当然，所述标记信息的具体形式并不限于上述描述，所属领域技术人员在本申请的技术精髓启示下，还可能做出其他的变更，但只要其实现的功能和效果与本申请相同或相似，均应涵盖于本申请保护范围内。
步骤S14：在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
在本实施方式中，所述预设条件可以为获得第一个标记信息起，且达到预定时长；或者标记信息个数达到预定的数量；或者接收到指定的发送信号，或者上述条件中的多个组合等，本申请在此并不作具体的限定。
具体的，在页面中可以设置有周期性监测模块，例如定时器等。当所述周期性监测模块监测到有数据集需要同步的预定标识，同时相应的获得了所述数据集的标记信息时，可以自获得第一个标记信息起，至达到预定时长时，针对所述与所述标记信息相对应的数据集发送数据同步请求。所述预定时长，可以根据实际业务需求进行设定，例如可以为1秒、3秒、5秒等等，本申请在此并不作具体的限定。此外，所述周期性监测模块也可以有计数功能。例如，其可以对所述标记信息进行计数，当所述标记信息的个数达到预定的个数时，针对与所述标记信息相对应的数据集发送数据同步请求。所述预定的个数也可以根据实际业务需求进行设定，例如可以为3个、5个、7个等等，本申请在此并不作具体的限定。当然，在所述页面中也可以设置有相应的发送按钮，当点击所述发送按钮时，可以触发指定的发送信号。当相应的请求发送模块接收到所述发送信号后，可以对与所述标记信息相对应的数据集发送数据同步请求。
在本实施方式中，所述数据同步请求具体的可以为Ajax请求，此外还可以用 websocket，长链接等其他技术方式实现浏览器和服务器的数据通信，本申请在此并不作具体的限定。在所述数据同步请求中可以包含有与所述数据集相对应的解析参数，例如，所述数据集的标记信息以及所述数据集具体需要同步的内容等。此外，所述数据同步请求还可以包含有处理服务器的地址信息，用于准确地向其发送数据同步请求。
本申请实施方式中，通过根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步，并获取需要同步的数据集的标记信息；进一步的将需要同步的数据集合并为一个数据同步请求进行页面数据的局部更新，在页面数据集同步过程中，能够根据所述预定标识判断是否需要同步，以及何时发送数据同步请求，实现了数据的自管理，降低数据的维护成本；特别是，当将需要同步的数据集合并为一个数据同步请求后，大大减少了数据同步请求的数量，能够大大降低数据维护的逻辑复杂度，同时当请求合并后，可大大减少http请求个数，从而减少耗在网络传输上的总体时间，相应地，dns路由等的解析次数，tcp握手次数也会相应较少，因此也能提高页面性能。
基于上述实施方式所述的网页中的数据处理方法，本申请还提供一种网页中的数据处理装置。
请参阅图3，所述网页中的数据处理装置可以包括：
接收模块11，用于接收触发信号；
状态监测模块13，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
标记模块15，用于获取需要同步的数据集的标记信息；
请求发送模块17，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
所述网页中的数据处理装置的另一种实施方式中，所述预设条件可以包括下述中的至少一个：
记录时间达到预定的时长；
标记信息个数达到预定的数量。
所述网页中的数据处理装置的另一种实施方式中，所述触发信号包括指定触发信号、周期性触发信号中的一个。
上述实施方式公开的网页中的数据处理装置与本申请网页中的数据处理方法实施方式相对应，可以实现本申请的网页中的数据处理方法实施方式并达到方法实施方式的技 术效果。
基于上述实施方式所述的网页中的数据处理方法，本申请还提供一种网页中的数据处理系统。
请参阅图4，所述网页中的数据处理系统可以包括：
接收模块11，用于接收触发信号；
状态监测模块13，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
标记模块15，用于获取需要同步的数据集的标记信息；
请求发送模块17，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
请求处理模块19，用于接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面；
回填模块21，用于利用所述待同步数据对相应的数据集进行回填处理。
上述实施方式公开的网页中的数据处理系统与本申请网页中的数据处理方法实施方式相对应，可以实现本申请的网页中的数据处理方法实施方式并达到方法实施方式的技术效果。
本申请中各个实施方式所涉及的上述描述仅是本申请中的一些实施方式中的应用，在某些标准、方法的基础上略加修改后的实施方式也可以实行上述本申请各实施方式的方案。当然，在符合本申请上述各实施方式的中所述的处理方法步骤的其他无创造性的变形，仍然可以实现相同的申请，在此不再赘述。
虽然本申请提供了如实施方式或流程图所述的方法操作步骤，但基于常规或者无创造性的劳动可以包括更多或者更少的操作步骤。实施方式中列举的步骤顺序仅仅为众多步骤执行顺序中的一种方式，不代表唯一的执行顺序。在实际中的装置或客户端产品执行时，可以按照实施方式或者附图所示的方法顺序执行或者并行执行(例如并行处理器或者多线程处理的环境)。
上述实施方式阐明的装置或模块，具体可以由计算机芯片或实体实现，或者由具有 某种功能的产品来实现。为了描述的方便，描述以上装置时以功能分为各种模块分别描述。在实施本申请时可以把各模块的功能在同一个或多个软件和/或硬件中实现。当然，也可以将实现某功能的模块由多个子模块或子单元组合实现。
本申请中所述的方法、装置或模块可以以计算机可读程序代码方式实现控制器按任何适当的方式实现，例如，控制器可以采取例如微处理器或处理器以及存储可由该(微)处理器执行的计算机可读程序代码(例如软件或固件)的计算机可读介质、逻辑门、开关、专用集成电路(Application Specific Integrated Circuit，ASIC)、可编程逻辑控制器和嵌入微控制器的形式，控制器的例子包括但不限于以下微控制器：ARC 625D、Atmel AT91SAM、Microchip PIC18F26K20以及Silicone Labs C8051F320，存储器控制器还可以被实现为存储器的控制逻辑的一部分。本领域技术人员也知道，除了以纯计算机可读程序代码方式实现控制器以外，完全可以通过将方法步骤进行逻辑编程来使得控制器以逻辑门、开关、专用集成电路、可编程逻辑控制器和嵌入微控制器等的形式来实现相同功能。因此这种控制器可以被认为是一种硬件部件，而对其内部包括的用于实现各种功能的装置也可以视为硬件部件内的结构。或者甚至，可以将用于实现各种功能的装置视为既可以是实现方法的软件模块又可以是硬件部件内的结构。
本申请所述装置中的部分模块可以在由计算机执行的计算机可执行指令的一般上下文中描述，例如程序模块。一般地，程序模块包括执行特定任务或实现特定抽象数据类型的例程、程序、对象、组件、数据结构、类等等。也可以在分布式计算环境中实践本申请，在这些分布式计算环境中，由通过通信网络而被连接的远程处理设备来执行任务。在分布式计算环境中，程序模块可以位于包括存储设备在内的本地和远程计算机存储介质中。
通过以上的实施方式的描述可知，本领域的技术人员可以清楚地了解到本申请可借助软件加必需的硬件的方式来实现。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，也可以通过数据迁移的实施过程中体现出来。该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，移动终端，服务器，或者网络设备等)执行本申请各个实施方式或者实施方式的某些部分所述的方法。
本说明书中的各个实施方式采用递进的方式描述，各个实施方式之间相同或相似的部分互相参见即可，每个实施方式重点说明的都是与其他实施方式的不同之处。本申请的全部或者部分可用于众多通用或专用的计算机系统环境或配置中。例如：个人计算机、 服务器计算机、手持设备或便携式设备、平板型设备、移动通信终端、多处理器系统、基于微处理器的系统、可编程的电子设备、网络PC、小型计算机、大型计算机、包括以上任何系统或设备的分布式计算环境等等。
本说明书中的上述各个实施方式均采用递进的方式描述，各个实施方式之间相同相似部分相互参照即可，每个实施方式重点说明的都是与其他实施方式不同之处。尤其对于服务器实施方式而言，由于其处理器执行的工作基本相似于方法实施方式，所以描述的比较简单，相关之处参见方法实施方式部分说明即可。
在本申请文件中，介绍了本申请的多个实施方式，所属领域技术人员可以理解得出，本申请中的实施方式之间可以互相组合。而且，所属领域技术人员知道，本申请有许多变形和变化而不脱离本申请的精神，希望所附的权利要求包括这些变形和变化而不脱离本申请的精神。

Claims (10)

  1. 一种网页中的数据处理方法，其特征在于，其包括：
    基于触发信号运行预设的数据集同步监测方式，根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
    获取需要同步的数据集的标记信息；
    在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求；
    接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面；
    利用所述待同步数据对相应的数据集进行回填处理。
  2. 如权利要求1所述的方法，其特征在于，所述预设条件包括下述中的至少一个：
    获得第一个标记信息起，且达到预定时长；
    所述标记信息个数达到预定的数量。
  3. 如权利要求1所述的方法，其特征在于，所述触发信号包括指定触发信号、周期性触发信号中的至少一个。
  4. 一种网页中的数据处理方法，其特征在于，其包括：
    基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
    获取需要同步的数据集的标记信息；
    在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
  5. 如权利要求4所述的方法，其特征在于，所述预设条件包括下述中的至少一个：
    获得第一个标记信息起，且达到预定时长；
    所述标记信息个数达到预定的数量。
  6. 如权利要求4所述的方法，其特征在于，所述触发信号包括指定触发信号、周期性触发信号中的至少一个。
  7. 一种网页中的数据处理装置，其特征在于，其包括：
    接收模块，用于接收触发信号；
    状态监测模块，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
    标记模块，用于获取需要同步的数据集的标记信息；
    请求发送模块，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求。
  8. 如权利要求7所述的装置，其特征在于，所述预设条件包括下述中的至少一个：
    获得第一个标记信息起，且达到预定时长；
    所述标记信息个数达到预定的数量。
  9. 如权利要求7所述的装置，其特征在于，所述触发信号包括指定触发信号、周期性触发信号中的一个。
  10. 一种网页中的数据处理系统，其特征在于，其包括：
    接收模块，用于接收触发信号；
    状态监测模块，用于基于触发信号运行预设的数据集同步监测方式；根据运行的所述数据集同步监测方式的返回结果确定数据集是否需要同步；
    标记模块，用于获取需要同步的数据集的标记信息；
    请求发送模块，用于在预设条件下，针对与所述标记信息相对应的数据集发送数据同步请求；
    请求处理模块，用于接收所述数据同步请求，基于所述数据同步请求获取相应的待同步数据，并将所述待同步数据返回页面；
    回填模块，用于利用所述待同步数据对相应的数据集进行回填处理。
PCT/CN2017/073136 2016-02-23 2017-02-09 网页中的数据处理方法、装置及系统 Ceased WO2017143909A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2018544539A JP6906540B2 (ja) 2016-02-23 2017-02-09 ウェブページデータ処理方法、装置及びシステム
EP17755738.6A EP3422210A4 (en) 2016-02-23 2017-02-09 METHOD, DEVICE AND SYSTEM FOR PROCESSING DATA IN A WEB PAGE
US16/109,291 US20180365307A1 (en) 2016-02-23 2018-08-22 Webpage data synchronization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610098831.6A CN107103004B (zh) 2016-02-23 2016-02-23 网页中的数据处理方法、装置及系统
CN201610098831.6 2016-02-23

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/109,291 Continuation US20180365307A1 (en) 2016-02-23 2018-08-22 Webpage data synchronization

Publications (1)

Publication Number Publication Date
WO2017143909A1 true WO2017143909A1 (zh) 2017-08-31

Family

ID=59658456

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/073136 Ceased WO2017143909A1 (zh) 2016-02-23 2017-02-09 网页中的数据处理方法、装置及系统

Country Status (6)

Country Link
US (1) US20180365307A1 (zh)
EP (1) EP3422210A4 (zh)
JP (1) JP6906540B2 (zh)
CN (1) CN107103004B (zh)
TW (1) TWI672027B (zh)
WO (1) WO2017143909A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347027A (zh) * 2019-08-09 2021-02-09 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
CN112347185A (zh) * 2019-08-09 2021-02-09 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
US11886880B2 (en) 2019-04-04 2024-01-30 Cambricon Technologies Corporation Limited Data processing apparatus and related products with descriptor management

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108710631B (zh) * 2018-04-02 2021-12-24 创新先进技术有限公司 一种数据获取的方法、装置及设备
CN112347026B (zh) * 2019-08-09 2023-03-31 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
CN112347186B (zh) * 2019-08-09 2023-02-28 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
CN112306945B (zh) * 2019-07-30 2023-05-12 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
CN111813851B (zh) * 2020-05-25 2023-10-20 车智互联（北京）科技有限公司 一种移动应用向网页同步数据的方法、系统及移动终端
CN112241436A (zh) * 2020-10-26 2021-01-19 云账户技术(天津)有限公司 一种区块链网络的切换方法及装置
CN115469750B (zh) * 2022-09-28 2026-04-14 辽宁向日葵数字技术股份有限公司 基于mr录播技术的多人协同虚拟交互方法
US12407642B2 (en) * 2023-10-02 2025-09-02 Google Llc Alias verification

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697274A (zh) * 2009-09-23 2010-04-21 易程科技股份有限公司 显示页面的生成方法及应用该方法的旅客引导显示系统
CN102945536A (zh) * 2012-10-23 2013-02-27 河海大学 一种适应分布式水文水资源数据库的数据展现系统与方法
CN103166916A (zh) * 2011-12-12 2013-06-19 深圳市金蝶中间件有限公司 页面更新方法及系统
CN104778211A (zh) * 2015-03-18 2015-07-15 微梦创科网络科技（中国）有限公司 一种局部刷新页面模块的方法、客户端、服务器及系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001249874A (ja) * 2000-03-08 2001-09-14 Sky Com:Kk 情報収集装置
JP2002041353A (ja) * 2000-07-28 2002-02-08 Toppan Printing Co Ltd 自動更新システム
US20050119910A1 (en) * 2003-12-01 2005-06-02 International Business Machines Corporation Content update notification
TW200825805A (en) * 2006-12-15 2008-06-16 Hon Hai Prec Ind Co Ltd System and method for loading related data into a web page
US7774788B2 (en) * 2007-03-07 2010-08-10 Ianywhere Solutions, Inc. Selectively updating web pages on a mobile client
US8275859B2 (en) * 2009-03-31 2012-09-25 International Business Machines Corporation Selective partial updates of web content
US20110066676A1 (en) * 2009-09-14 2011-03-17 Vadim Kleyzit Method and system for reducing web page download time
US9406082B2 (en) * 2012-10-05 2016-08-02 Redfin Corporation Multiplexing web requests for improved performance
CN102904957A (zh) * 2012-10-16 2013-01-30 浪潮(北京)电子信息产业有限公司 一种高可用集群中更新信息的方法和系统
US20140122573A1 (en) * 2012-11-01 2014-05-01 Miiicasa Taiwan Inc. Method and system for processing data through network
CN104346374A (zh) * 2013-07-31 2015-02-11 阿里巴巴集团控股有限公司 一种数据处理方法及系统
JP2015052821A (ja) * 2013-09-05 2015-03-19 株式会社東芝 通信装置および通信方法
CN103678526A (zh) * 2013-11-29 2014-03-26 贝壳网际（北京）安全技术有限公司 浏览器解码图片的方法、装置和客户端
CN104965737B (zh) * 2015-06-25 2018-04-27 广州华多网络科技有限公司 更新数据的获取方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697274A (zh) * 2009-09-23 2010-04-21 易程科技股份有限公司 显示页面的生成方法及应用该方法的旅客引导显示系统
CN103166916A (zh) * 2011-12-12 2013-06-19 深圳市金蝶中间件有限公司 页面更新方法及系统
CN102945536A (zh) * 2012-10-23 2013-02-27 河海大学 一种适应分布式水文水资源数据库的数据展现系统与方法
CN104778211A (zh) * 2015-03-18 2015-07-15 微梦创科网络科技（中国）有限公司 一种局部刷新页面模块的方法、客户端、服务器及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3422210A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11886880B2 (en) 2019-04-04 2024-01-30 Cambricon Technologies Corporation Limited Data processing apparatus and related products with descriptor management
US12346697B2 (en) 2019-04-04 2025-07-01 Cambricon Technologies Corporation Limited Data processing apparatus and related products
CN112347027A (zh) * 2019-08-09 2021-02-09 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品
CN112347185A (zh) * 2019-08-09 2021-02-09 安徽寒武纪信息科技有限公司 数据同步方法及装置以及相关产品

Also Published As

Publication number Publication date
TWI672027B (zh) 2019-09-11
JP6906540B2 (ja) 2021-07-21
JP2019512129A (ja) 2019-05-09
CN107103004A (zh) 2017-08-29
CN107103004B (zh) 2020-11-06
EP3422210A4 (en) 2019-10-23
US20180365307A1 (en) 2018-12-20
EP3422210A1 (en) 2019-01-02
TW201735589A (zh) 2017-10-01

Similar Documents

Publication Publication Date Title
WO2017143909A1 (zh) 网页中的数据处理方法、装置及系统
JP7271734B2 (ja) 分散イベント処理システムにおけるデータシリアライズ
CN111694857B (zh) 存储资源数据的方法、装置、电子设备及计算机可读介质
CN107798108B (zh) 一种异步任务查询方法及设备
CN105718540B (zh) 数据加载方法和装置
US9721246B2 (en) Synchronization patterns for mobile applications
CN108628881A (zh) 数据同步方法和装置
CN110297944B (zh) 分布式xml数据处理方法及系统
CN106030456A (zh) 自动异步切换标识
CN108595234A (zh) 应用页面切换方法、装置及设备
CN105069163B (zh) 网络请求处理方法和装置
US20210149709A1 (en) Method and apparatus for processing transaction
Georgantas et al. Service-oriented distributed applications in the future internet: The case for interaction paradigm interoperability
EP3872630A2 (en) Request processing method and apparatus, electronic device, and computer storage medium
CN105068801A (zh) 修改json日期格式的方法及系统
CA2965283C (en) Systems and methods of subject state change notification
CN109981546B (zh) 获取应用模块间的远程调用关系的方法和装置
CN110417919A (zh) 一种流量劫持方法及装置
CN108965359B (zh) 通信方法、通信装置、可读介质和电子设备
CN117170891A (zh) 消息处理方法、装置及设备
CN108023905A (zh) 物联网应用系统及方法
CN110809041B (zh) 一种数据同步方法、装置、电子设备及存储介质
CN106911784B (zh) 一种执行异步事件的方法和装置
CN114428671A (zh) 数据处理方法、装置、电子装置和存储介质
US20200374337A1 (en) Transmitting data over a network in representational state transfer (rest) applications

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018544539

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017755738

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017755738

Country of ref document: EP

Effective date: 20180924

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17755738

Country of ref document: EP

Kind code of ref document: A1