CN105391602A - Data acquisition test method and device - Google Patents

Abstract

The embodiment of the present invention provides a method and device for data collection and testing. The method includes: receiving uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running; searching for the parameter information from the parameter information The storage parameters correspond to the storage information; the data quality is detected according to the storage information, and the quality verification result is determined. The embodiment of the present invention extracts the storage information corresponding to the storage parameters from the parameter information, detects the data quality according to the storage information, and judges whether the uploaded parameter information is fake data, that is, determines the quality verification result, thereby avoiding the use of fake data. The collection of data, to ensure the accuracy of data collection, thereby improving the accuracy of data collection.

Description

A data collection test method and device

technical field

The invention relates to the field of communication technology, in particular to a data collection and testing method and a data collection and testing device.

Background technique

With the rapid development of communication technology, especially with the popularization of mobile Internet, the popularization of smart terminals is getting faster and faster, and the functions of smart terminals are becoming more and more abundant. Among them, the smart terminal implements its functions by installing various applications, and provides diversified services.

In order to improve service quality, developers of each service platform need to set up a data collection scheme to collect application data to understand business needs. Among them, different services need to collect different application data. Therefore, developers of the service platform need to set up different application data collection schemes according to different businesses.

Specifically, the developer of the service platform needs to set the collection parameters of each application according to the services provided by the service platform, collect data for each application according to the set collection parameters, and generate a business report of the service platform to understand business needs. However, there are many applications installed on smart terminals, that is, a large amount of application data needs to be collected, which makes it difficult to unify the data collection formats of each service platform. Therefore, the developers of each service platform also need to define the data collection format of each application, so that each service platform can collect the data of each application according to the set data collection format, further increasing the workload of the developers.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a data collection and testing method and a corresponding data collection and testing device that overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a kind of data acquisition test method is provided, comprising:

receiving the uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running;

Searching for storage information corresponding to storage parameters from the parameter information;

Data quality is detected according to the stored information, and a quality verification result is determined.

Optionally, searching for storage information corresponding to storage parameters from the parameter information includes:

Determine the storage ID of the storage parameter, and search for the storage information corresponding to the storage ID from the parameter information.

Optionally, the data quality is detected according to the stored information, and the quality verification result is determined, including:

Find at least one terminal identifier according to the stored information;

The terminal identification is used to detect data quality, and the quality verification result is determined.

Optionally, the terminal identification is used to detect data quality, and the quality verification result is determined, including:

When the stored information corresponds to a terminal identifier, generate a qualified quality verification result;

When the stored information corresponds to more than one terminal identifier, a quality verification result of abnormal data is generated.

Optionally, the method further includes: when there is more than one terminal identifier in the terminal identifier, searching for successful upload information corresponding to the terminal identifier;

Sort the upload success information corresponding to each terminal identifier;

When it is determined according to the sorting result that there is no redundancy in the upload success information, it is determined that the data is abnormal.

Optionally, the storage parameters include: secure digital storage SD card parameters, and the corresponding storage information of the storage parameters includes: SD card information.

According to another aspect of the present invention, a kind of data acquisition testing device is provided, comprising:

A parameter information receiving module, configured to receive uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running;

A storage information search module, configured to search the storage information corresponding to the storage parameters from the parameter information;

A data quality detection module, configured to detect data quality according to the stored information, and determine a quality verification result.

Optionally, the storage information searching module is specifically configured to determine a storage identifier of a storage parameter, and search the storage information corresponding to the storage identifier from the parameter information.

Optionally, the data quality detection module includes:

A terminal identification search submodule, configured to search for at least one terminal identification according to the stored information;

The quality verification sub-module is configured to use the terminal identification to detect data quality and determine a quality verification result.

Optionally, the quality checking submodule includes:

A qualified result generating unit, configured to generate a qualified quality verification result when the stored information corresponds to a terminal identifier;

The abnormal result generating unit is configured to generate a quality verification result of data abnormality when the stored information corresponds to more than one terminal identifier.

Optionally, also include:

An upload information search module, configured to search for successfully uploaded information corresponding to the terminal identifier when there is more than one terminal identifier in the terminal identifier;

The information sorting module is used to sort the successful upload information corresponding to each terminal identifier;

An abnormality judging module, configured to judge data abnormality when it is determined that there is no redundancy in the successful upload information according to the sorting result.

Optionally, the storage parameters include: secure digital storage SD card parameters, and the corresponding storage information of the storage parameters includes: SD card information.

According to the data collection and testing scheme of the present invention, the stored information can be searched from the uploaded parameter information, and the quality of the data can be detected according to the stored information, and whether the collected data is analyzed is abnormal, that is, it can be judged whether there is data falsification, and the quality verification result can be determined. In this way, the problem of low accuracy of data collection due to data falsification of the terminal equipment is solved, and the beneficial effect of improving the accuracy of collected data is achieved.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

Fig. 1 shows a structural block diagram of a data collection and analysis system according to an embodiment of the present invention;

Fig. 2 shows the flow chart of the steps of the data collection test method according to one embodiment of the present invention;

Fig. 3 shows a flow chart of the steps of a data collection and testing method according to another embodiment of the present invention;

Fig. 4 shows a structural block diagram of a data acquisition testing device according to an embodiment of the present invention;

Fig. 5 shows a structural block diagram of a data acquisition testing device according to another embodiment of the present invention;

Fig. 6 shows a structural block diagram of a data collection and analysis system according to another embodiment of the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

Usually, suppliers and software developers of some terminals such as mobile phones and tablet PCs collect running data of applications installed on the terminals, analyze the collected data, and generate business reports to understand business needs. The embodiment of the present invention provides a data collection and analysis system, which is versatile and can collect and analyze data and generate different business reports for various applications.

Referring to FIG. 1 , it shows a structural block diagram of a data collection and analysis system according to an embodiment of the present invention.

The data collection and analysis system includes: a collection control server 102, a data analysis server 104, a report generation server 106 and at least one data terminal 108, and a collection tool is installed in the data terminal.

The collection control server 102 is configured to configure the collection configuration information to a data terminal and send it to a corresponding data terminal, wherein the configuration information is used to control collection of collection parameters.

The data terminal 108 is configured to call the collection tool when the application is running, collect parameter information of the collection parameters according to the collection configuration information; and upload the collected parameter information to the data analysis server.

The data analysis server 104 is configured to analyze the uploaded parameter information corresponding to each collection parameter to obtain a data analysis result; and send the data analysis result to the report generation server.

The report generation server 106 is configured to generate a data report according to the data analysis result.

Wherein, the data analysis server is further configured to search the storage information corresponding to the storage parameters from the parameter information; detect the data quality according to the storage information, and determine the quality verification result. Therefore, through the control of the collection control server, the collection tool can collect the parameter information of each collection parameter in the data terminal where the application is running. After uploading to the data analysis server, through the analysis of the data analysis server, the quality verification result of the data can be determined, that is, whether there is data fraud; and data analysis is performed according to statistical requirements and quality verification results to generate corresponding business data report. Through this data report, the user's needs and habits can be learned, and the business can be adjusted to better meet the user's needs.

The embodiment of the present invention discusses in detail the quality verification of the uploaded parameter information by the data analysis server.

Embodiment one

Referring to Fig. 2, it shows a flow chart of the steps of the data collection and testing method according to one embodiment of the present invention, which may specifically include the following steps:

Step 202, receiving uploaded parameter information.

Wherein, the parameter information is collected for each collection parameter when the application is running.

In fact, when data terminals (referred to as terminals) such as mobile phones and tablet computers collect application data through collection tools, that is, after collecting the parameter information corresponding to each collection parameter, they will upload the collected parameter information to make data analysis The server can receive the uploaded parameter information. The parameter information may include storage information, verification information, information corresponding to acquisition parameters, and the like. Among them, the storage information can be used to detect data quality and determine the quality verification results, such as Secure Digital Memory Card (SecureDigitalMemoryCard) information (referred to as SD card information), multimedia memory card (MultiMediaCard, MMC) information, SM card (SmartMediaCard) information, CF Card (CompactFlashCard) information, etc.; verification information can be used to analyze data transmission and determine hijacking verification results, such as IP (Internet Protocol) address information; parameter information corresponding to collection parameters can include parameter information corresponding to dynamic parameters and/or static Parameter information of parameters, such as application interface startup information, button click information, duration information, exception information and session information, identification information of the terminal where the application is located, version information, channel information, network type, resolution information, etc. The identification information of the terminal includes the terminal identification, which can be used to identify the terminal where the application is located.

Step 204, look up storage information corresponding to the storage parameters from the parameter information.

After receiving the parameter information, the data analysis server may analyze the parameter information, and search for storage information corresponding to the storage parameters from the parameter information. Specifically, preset storage parameters can be set according to detection needs, such as preset SD card parameters. In the process of data analysis, by searching for the storage information corresponding to the preset storage parameters, the storage information corresponding to the storage parameters can be obtained.

Optionally, the data analysis server may find the storage information corresponding to the storage identifier from the parameter information by determining the storage identifier of the storage parameter.

As a specific example of the present invention, the storage parameters are hardware storage parameters, such as secure digital storage SD card parameters, referred to as SD card parameters, then the corresponding storage information is SD card information, and the SD card can be found according to the SD card information The corresponding SD card ID. In the process of analyzing data, the data analysis server can obtain the storage information corresponding to the storage identifier from the parameter information by determining the storage identifier of the storage parameter, such as the SD card identifier, such as obtaining the SD card information corresponding to the SD card parameter .

Step 206, check the quality of the data according to the stored information, and determine the result of the quality verification.

After extracting the stored information, the data analysis server uses the stored information to perform data quality inspection on the parameter information to determine whether there is data falsification in the collected parameter information, that is, to judge the accuracy of the collected parameter information and determine the quality verification result. Specifically, the data analysis server can search for the corresponding terminal ID of the terminal where the application is located based on the stored information, such as an SD card ID, and use the terminal ID to detect data quality, that is, determine whether the parameter information is fake data. When the stored information corresponds to a terminal identification, such as SD card information corresponds to an SD card identification, that is, the SD card information corresponds to an SD card, it can be determined that the data is normal, that is, it can be determined that the uploaded parameter information is not fake data, and the generated quality is qualified. Quality check results. When the stored information corresponds to more than one terminal ID, such as the same SD card information corresponds to 38 SD card IDs, that is, the same SD card has 38 SD card IDs, it can be determined that the data is abnormal, that is, the uploaded parameter information may be fake data , to generate the quality check result of abnormal data.

In the embodiment of the present invention, by extracting the storage information corresponding to the storage parameters from the uploaded parameter information, the data quality detection is performed according to the extracted storage information, and it is judged whether the uploaded parameter information is fake data, that is, the quality calibration is determined. The results of the test can avoid the use of falsified data collection and ensure the accuracy of data collection, thereby improving the accuracy of data collection.

Embodiment two

Referring to FIG. 3 , it shows a flow chart of the steps of a data collection and testing method according to another embodiment of the present invention, which may specifically include the following steps:

Step 302, receiving uploaded parameter information.

Wherein, the parameter information is collected for each collection parameter when the application is running.

In the data collection and analysis system, the collection control server determines the application to be collected based on the data collected by each service platform. After the application is determined, the cloud server can determine the static parameters and dynamic parameters of the application to be collected according to the application type, and set the collection configuration information, so that each application or application terminal can collect and upload the collected data according to the collection configuration information. Parameters correspond to parameter information.

It should be noted that the static parameters can be used to collect static parameter information corresponding to the application, such as identification information, version information, channel information, network type and resolution information of the terminal where the application is located. Among them, the identification information of the terminal includes the terminal identification, which can be used to identify the terminal where the application is located. For example, the M2 value can be calculated based on the terminal hardware and other information. The M2 value can be calculated through the serial number, model number, version information, etc. The value can identify different terminals without revealing the hardware information of the terminal, ensuring the privacy and security of users. For example, the M2 value of the SD card can be calculated based on the information of the SD card, and the M2 value of the SD card can be used as the SD card identification. Calculate the serial number, model number, Android number and other information of the SD card to get the SD card identification. The version information may be used to record the corresponding version of the application, such as the terminal operating system version, software version or software development kit version, and the like. The channel information can be used to identify the acquisition path of the application. The network type can be used to determine the network type connected to the terminal where the application is located. The resolution information can be used to determine the display resolution of the terminal where the application is located, and the display resolution can also be called a screen resolution.

Dynamic parameters can be used to collect parameter information generated during the running of the application, such as application interface startup information, button click information, duration information, exception information, and session information. Among them, the application interface startup information is used to record the page before switching and the interface after switching when the interface of the application is switched; the button click information is used to record the button number corresponding to each button clicked by the user in the application and the number of clicks corresponding to the button number; The duration information is determined according to the startup time point and shutdown time point, such as the application running time and interface running time; the exception information is used to record the information about the abnormal operation of the application, such as the time point or number of times when the application fails to start; the session information is used to record the application in the Session class messages generated at runtime.

The cloud server can determine the application to be collected based on the data to be collected by each service platform. After the application is determined, the collection tool can determine the dynamic parameters of the application to be collected according to the application type. Dynamic parameters can be used to collect parameter information generated during the running of the application, such as application interface startup information, button click information, duration information, exception information, and session information. The collection tool collects the parameter information of the dynamic parameters in real time according to the operation of the application.

Among them, the application interface startup information is used to record the page before switching and the interface after switching when the interface of the application is switched; the button click information is used to record the button number corresponding to each button clicked by the user in the application and the number of clicks corresponding to the button number; The duration information is determined according to the startup time point and shutdown time point, such as the application running time and interface running time; the exception information is used to record the information about the abnormal operation of the application, such as the time point or number of times when the application fails to start; the session information is used to record the application in the Session class messages generated at runtime.

Wherein, collecting the parameter information of the dynamic parameters in real time according to the operation of the application includes:

When the interface switch of the application is detected, the interface before the switch is recorded as the previous page, and the interface after the switch is recorded as the current page, and the previous page and the current page are added to the application interface startup information. That is to say, when recording the user's access in the application interface, in order to ensure the continuity of the access, the previous access interface can be recorded while recording the current interface, so that each interface record is the current page + the previous page. Of course, if it is the home page, then The previous page is empty.

When it is detected that the button of the application is triggered, the button number corresponding to the button is obtained, the number of clicks corresponding to the button number is updated, and the button number and the number of clicks are added to the button click information. The application can include many buttons, and each button can be numbered to identify different buttons, so that when the button is clicked, the button number and the number of clicks are recorded, that is, the number of clicks is initially 0, and one is added for each click.

The application can run in a multi-process mode. Usually, when the application starts with multiple processes, the main process is used to record the start time point, and the last process is used to record the end time point. However, when the application startup time is too short, it may occur that the main process is not fully started. If the problem has been closed, the recorded running time may be a negative value at this time, or if the time is calculated by using the start time of the last startup and the end time of this shutdown, the time will be too long, causing the time record to be incorrect. precise.

In order to solve the above inaccurate problem, the running time related to the application is collected as duration information, wherein the duration information includes: interface running time and application running time. Wherein, the collecting the running time related to the application as the duration information includes: the main process of the application records the start time point and the end time point, records the running time according to the start time point and the end time point, and records the running time Time as duration information. That is to say, this embodiment is aimed at the application of multi-process operation. The records of the start and end time are all recorded from the main process, that is, the main process is used to record the start time point when the application is started, and the end time point is recorded by the main process when the application is closed, so as to calculate The difference between the end time point and the start time point is the running time to ensure accurate recording of the running time.

In the embodiment of the present invention, the cloud server can connect to the terminal where each application is located to deliver configuration information through a wireless or wired connection, so that after the collection tool collects the parameter information of each collection parameter, it can upload the parameter information corresponding to the collection parameter to the data analysis server . The data analysis server can analyze the parameter information according to the preset algorithm, and the report generation server generates the business information required by each service platform based on the statistical results, such as generating business reports and determining business indicators.

Step 304, determine the storage ID of the storage parameter, and search the storage information corresponding to the storage ID from the parameter information.

In the embodiment of the present invention, the data analysis server can determine the stored information to be extracted according to the requirements of data quality testing, and use the extracted stored information to perform data quality testing on the parameter information to determine whether the uploaded parameter information is abnormal. Specifically, by determining the storage identifier of the storage parameter, a search can be performed based on the determined parameter identifier; if the storage information corresponding to the determined storage identifier is found from the parameter information, the found storage information can be extracted, so as to The uploaded parameter information is tested for data quality, such as judging whether the uploaded parameter information is fake data.

In fact, the storage parameters set by the data analysis server may include SD card parameters, and the storage information corresponding to the storage parameters may include SD card information. As a specific example of the present invention, the data analysis server can search the received parameter information according to the SD card identifier by determining the SD card identifier, and extract the SD card information corresponding to the SD card identifier from the parameter information.

It should be noted that each SD card has a unique corresponding SD card ID, and the SD card information can be used to find the SD card ID corresponding to the SD card.

Step 306, searching for at least one terminal identifier according to the stored information.

After extracting the stored information, data quality testing can be performed based on the stored information to determine whether there is data falsification in the collected parameter information. Specifically, extract the identification information of each terminal from all the received parameter information; and judge whether the terminal identification of the extracted identification information corresponds to the extracted storage information; if the terminal identification corresponds to the extracted storage information, it can be determined The extracted storage information is the storage information of the terminal, and a corresponding relationship between the extracted storage information and the terminal identifier of the terminal is established.

As a specific example of the present invention, assume that terminal A, terminal B and terminal C are connected to the same SD card, marked as SD card 1, and the SD card information of SD card 1 is marked as SD card information 1; terminal D is connected to another The SD card is marked as SD card 2, and the SD card information of SD card 2 is marked as SD card information 2. When the data analysis server extracts the SD card information from the parameter information uploaded by terminal A, terminal B, or terminal C, the extracted SD card information is SD card information 1. According to the SD card information 1, the SD card identification can be found, and the terminal can be found. The SD card ID corresponding to A, the SD card ID corresponding to terminal B, and the SD card ID corresponding to terminal C, that is, search the uploaded parameter information according to SD card information 1, and obtain the 3 SD card IDs corresponding to SD card information 1. When the data analysis server extracts the SD card information from the parameter information uploaded by terminal D, the extracted SD card information is SD card information 2. According to the SD card information 2, the SD card identification can be found, and the SD card identification corresponding to terminal D can be found , that is, search the uploaded parameter information according to the SD card information 2, and obtain an SD card ID corresponding to the SD card information 2.

Step 308, using the terminal identifier to detect data quality, and determine a quality verification result.

In a specific implementation, the data analysis server can count the terminal identifiers corresponding to the stored information, determine the number of terminal identifiers corresponding to the stored information, and judge whether the stored information belongs to a terminal based on the number of terminal identifiers, which is equivalent to judging that the stored information Whether there is data falsification in the corresponding parameter information. If the number of terminal identifiers corresponding to the stored information is 1, then the stored information belongs to one terminal. For example, in the above example, SD card information 2 belongs to terminal D, and it can be determined that the collected data is normal, that is, it can be determined that the SD card information 2 corresponds to The parameter information is not falsified data, and the quality verification result of the data collection quality is generated. If the number of terminal identifiers corresponding to the stored information is not 1, the stored information does not belong to one terminal. For example, in the above example, SD card information 1 belongs to 3 terminals, and it can be determined that the collected data is abnormal, that is, SD card information 1 The corresponding parameter information may be fake data, and an abnormal quality verification result of the data is generated.

Optionally, when the stored information corresponds to a terminal identifier, a quality verification result of qualified quality is generated. When the stored information corresponds to more than one terminal identifier, a quality verification result of abnormal data is generated.

Specifically, when the stored information corresponds to a terminal identifier, the data analysis server can determine that the parameter information corresponding to the stored information is normal data, and can use the parameter information for data analysis to generate the data reports required by each service platform to understand Business needs, adjust the business.

Optionally, when there is more than one terminal identifier in the terminal identifier, search for the successful upload information corresponding to the terminal identifier; sort the upload success information corresponding to each terminal identifier; determine that there is no redundancy in the upload success information according to the sorting result. In the rest of the time, it is judged that the data is abnormal.

In fact, some terminal devices, such as monitors, where applications are located, have no local storage space, and are connected to a processor or a hard disk to process data using the storage space of the processor or hard disk. Wherein, multiple terminals can share the same processor or storage space of the hard disk to process data, for example, multiple displays are connected to the same SD card, that is, they share the same storage space of the SD card. In the process of collecting data, data is collected from multiple terminals connected to the same hard disk or processor, and the parameter information collected is actually the data of the same hard disk or processor.

When the stored information corresponds to more than one terminal identifier, the data analysis server may search for successfully uploaded information corresponding to each terminal identifier, such as successful transmission log information (transformation). The successfully uploaded information corresponding to the terminal identifier includes the number of successful transmission times, such as the number of times transformationtimes (referred to as tt value) for successful log transmission. Every time the collected parameter information is successfully uploaded, the tt value will automatically increase according to the unit value, such as automatically adding 1.

When the stored information corresponds to more than one terminal identifier, the data analysis server can sort the upload success information corresponding to each terminal identifier, such as sorting according to the size of the tt value, and judge whether there is redundancy in the upload success information based on the sorting result. When there is no redundancy in the successful upload information, it can be determined that the multiple terminal identifiers corresponding to the stored information are actually the data of the same processor or hard disk, that is, there is data falsification, and it is determined that the data is abnormal. Combined with the above example, SD card information 1 corresponds to 3 SD card identifiers, and the data analysis server sorts the number of successful log transfers according to the size of the tt value, and judges whether the number of successful log transfers is repeated; when the number of successful log transfers is not repeated When , that is, when there is no redundancy in the number of successful log transmissions, it can be determined that the data is abnormal. The tt value of the corresponding SD card ID is 2, that is, there is no redundancy in the number of successful log transfers, and it can be determined that the parameter information containing SD card information 1 is abnormal, which is equivalent to determining that the parameter information containing SD card information 1 has data falsification, and generating The quality verification result of data abnormality avoids the parameter information for data analysis, that is, avoids the use of abnormal parameter information for analysis, and improves the accuracy of data collection.

In the embodiment of the present invention, when the stored information corresponds to more than one terminal identifier, the data analysis server can determine that the data is abnormal, and generate a quality verification result of the data abnormality, so as to avoid using abnormal data for data analysis and ensure the accuracy of the data analysis results. accuracy.

For the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action order, because according to the embodiment of the present invention , certain steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Embodiment Three

Referring to Fig. 4, it shows a structural block diagram of a data acquisition and testing device according to an embodiment of the present invention, which may specifically include the following modules:

The parameter information receiving module 402 is configured to receive uploaded parameter information.

Wherein, the parameter information is collected for each collection parameter when the application is running.

The storage information searching module 404 is configured to search the storage information corresponding to the storage parameters from the parameter information.

The data quality detection module 406 is configured to detect data quality according to the stored information, and determine a quality verification result.

In the embodiment of the present invention, by extracting the storage information corresponding to the storage parameters from the uploaded parameter information, the data quality detection is performed according to the extracted storage information, and it is judged whether the uploaded parameter information is fake data, that is, the quality calibration is determined. The results of the test can avoid the use of falsified data collection and ensure the accuracy of data collection, thereby improving the accuracy of data collection.

Referring to Fig. 5, it shows a structural block diagram of a data acquisition and testing device according to an embodiment of the present invention, which may specifically include the following modules:

In a preferred embodiment of the present invention, the storage information search module 404 is specifically configured to determine the storage identifier of the storage parameter, and search the storage information corresponding to the storage identifier from the parameter information.

Optionally, the data quality detection module 406 may include:

Wherein, the terminal identification search submodule 4060 is configured to search for at least one terminal identification according to the stored information. The quality verification sub-module 4062 is configured to use the terminal identifier to detect data quality and determine a quality verification result.

Optionally, the quality checking submodule 4062 may include the following units:

The qualified result generating unit 40620 is configured to generate a qualified quality verification result when the stored information corresponds to a terminal identifier.

The abnormal result generating unit 40622 is configured to generate a quality verification result of data abnormality when the stored information corresponds to more than one terminal identifier.

In a preferred embodiment of the present invention, the data collection and testing device can also include the following modules:

The upload information search module 408 is configured to search for successful upload information corresponding to the terminal identifier when there is more than one terminal identifier.

An information sorting module 410, configured to sort the upload success information corresponding to each terminal identifier;

An abnormality judging module 412, configured to judge data abnormality when it is determined that there is no redundancy in the upload success information according to the sorting result. Wherein, the abnormality judging module 412 may also trigger the abnormal result generating unit 40622, so that the abnormal result generating unit 40622 generates a quality verification result of abnormal data.

Optionally, the storage parameters may include secure digital storage SD card parameters; the storage information corresponding to the storage parameters may include: SD card information.

In the above-mentioned data collection and analysis system, the data collection device of this embodiment can be configured in the data analysis server, as shown in Figure 6, the data collection and analysis system includes: collection control server 102, data analysis server 104, report generation server 106 and at least one data terminal 108, the collection tool is installed in the data terminal. The collection and control server 102 includes: a cloud control server 1022 and a development and configuration server 1024 .

Wherein, the collection control server 102 configures the collection configuration information to the data terminal and sends it to the corresponding data terminal 108; the data terminal 108 invokes the collection tool when the application is running, and the parameter information of the collection parameters according to the collection configuration information Collect; the data terminal 108 uploads the collected parameter information to the collection control server 104; the data analysis server 104 analyzes the corresponding parameter information of each collection parameter uploaded, and obtains data analysis results; the data analysis server 104 sends the data analysis result to the report generation server 106; the report generation server 106 generates a data report according to the data analysis result.

In an example, the collection control server 102 is configured to configure the collection configuration information to a data terminal and send it to a corresponding data terminal, wherein the configuration information is used to control the collection of collection parameters; the data terminal 108 , for invoking the collection tool when the application is running, and collecting the parameter information of the collection parameters according to the collection configuration information; and uploading the collected parameter information to the data analysis server; the data analysis server 104 is used for The uploaded acquisition parameters are analyzed corresponding to the parameter information to obtain data analysis results; the data analysis results are sent to the report generation server; the report generation server 106 is used to generate data reports according to the data analysis results.

In an optional embodiment, the collection control server 102 includes a cloud control server 1022; the cloud control server 1022 is configured to determine the collection parameters of the application according to the application type, wherein the collection parameters include: dynamic parameters and /or static parameters; collect configuration information according to the configuration of the application and the terminal where the application is located, wherein the collection configuration information is used to control the collection and uploading of the collection parameters; send the collection parameters and collection configuration information to the terminal where the application is located data terminal.

Wherein, the collection control server configures the collection configuration information to the data terminal and sends it to the corresponding data terminal, including: the collection control server determines the collection parameters of the application according to the application type, wherein the collection parameters include : dynamic parameters and/or static parameters; collection configuration information configured according to the application and the terminal where the application is located, wherein the collection configuration information is used to control the collection and upload of the collection parameters; download the collection parameters and collection configuration information Send to the data terminal where the application is located.

The cloud control server 1022 is configured to configure upload conditions and/or sampling conditions of parameter information, add the upload conditions and/or sampling conditions to the collection configuration information; configure the collection threshold corresponding to the memory of the terminal where the application is located, and set the The collection threshold is added to the collection configuration information; the upload interval of the terminal corresponding to the network type of the application is configured, and the upload interval is added to the collection configuration information; the cache threshold corresponding to the terminal of the application is configured, and the The cache threshold is added to the collection configuration information; and, the protocol upload sequence, sampling rate and priority of sampling parameters are configured in the collection configuration information.

The step of collecting configuration information configured according to the application and the terminal where the application is located includes at least one of the following: configuring upload conditions and/or sampling conditions of parameter information, adding the upload conditions and/or sampling conditions to the collection configuration information; The collection threshold of the memory corresponding to the terminal where the application is located, adding the collection threshold to the collection configuration information; configuring the upload interval corresponding to the network type of the terminal where the application is located, and adding the upload interval to the collection configuration information; configuring The terminal where the application is located corresponds to a cache threshold, and the cache threshold is added to the collection configuration information; the protocol upload sequence, sampling rate, and priority of sampling parameters are configured in the collection configuration information.

Wherein, the data terminal 108 is used to collect the parameter information of the static parameters of the application according to the collection configuration information by using the collection tool; and, use the collection tool to determine the dynamic parameters to be collected according to the collection configuration information, The operation collects the parameter information of the dynamic parameters in real time.

The collecting the parameter information of the collection parameters according to the collection configuration information includes: using the collection tool to collect the parameter information of the static parameters of the application according to the collection configuration information; using the collection tool to determine the parameters to be collected according to the collection configuration information A dynamic parameter, collecting parameter information of the dynamic parameter in real time according to the operation of the application.

The data terminal 108 is configured to record that the interface before the switch is the previous page, record the interface after the switch as the current page, and add the previous page and the current page to the application when the interface switching of the application is detected. In the interface startup information; when it is detected that the button of the application is triggered, obtain the button number corresponding to the button, update the number of clicks corresponding to the button number, and add the button number and the number of clicks to the button click information ; collecting the running time related to the application as duration information, wherein the duration information includes: interface running time and application running time.

The step of collecting the parameter information of the dynamic parameters in real time according to the operation of the application includes at least one of the following: when the interface switch of the application is detected, the interface before the switch is recorded as the previous page, and the interface after the switch is recorded as For the current page, add the previous page and the current page to the application interface startup information; when it is detected that the button of the application is triggered, obtain the button number corresponding to the button, and update the number of clicks corresponding to the button number , adding the button number and the number of clicks to the button click information; collecting the running time related to the application as duration information, wherein the duration information includes: interface running time and application running time.

Wherein, the parameter information of the static parameters includes at least one of the following: terminal identification, version information, channel information, network type and resolution information; the parameter information of the dynamic parameters includes at least one of the following: application interface startup information, button Click information, duration information, exception information and session information.

In this embodiment, the report generation server 106 is configured to obtain service statistics according to the configured custom management information corresponding to the custom events of the application; generate a custom event report according to the custom management information and business statistics.

The report generation server generates a data report according to the data analysis result, including: the report generation server obtains business statistical information according to the custom management information of the configured application corresponding to the custom event; according to the custom management information and business Statistics generate custom event reports.

The report generation server 106 is further configured to obtain the application path of the application from the business management page, and the custom event information corresponding to the custom event of the application, wherein the custom event information includes: event Name and event attributes; use the application path and custom event information to generate custom management information.

It also includes the step of configuring custom management information: obtaining the application path of the application from the business management page, and the custom event information corresponding to the custom event of the application, wherein the custom event information includes: event Name and event attributes; use the application path and custom event information to generate custom management information.

The report generation server 106 is configured to determine the application according to the application path; for each custom event, obtain the logical name corresponding to the event name and the logical attribute corresponding to the event attribute; find the corresponding logical name Collect parameters, determine business statistics corresponding to the collection parameters according to the logical attributes; and determine event names corresponding to each collection parameter, and use each event name and business statistics corresponding to the collection parameters to generate a user-defined event report for the application.

According to the custom management information of the configured application corresponding to the custom event, obtain business statistical information; generate a custom event report according to the custom management information and business statistical information, including: determine the application according to the application path; Define an event, obtain the logical name corresponding to the event name, and the logical attribute corresponding to the event attribute; find the collection parameters corresponding to the logical name, and determine the business statistical information corresponding to the collection parameter according to the logical attribute; determine each Collect the event names corresponding to the parameters, and use each event name and business statistics corresponding to the collected parameters to generate a custom event report for the application.

Wherein, the collection control server is also used to configure the test information of the test equipment corresponding to the target application; the data analysis server is also used to analyze the parameter information uploaded correspondingly to the target application; determine the parameter information When it belongs to the test equipment, it analyzes the parameter information belonging to the test equipment in real time; the report generation server is also used to judge that when the parameter information belongs to the test equipment, it generates a data report in real time according to the data analysis results.

The method further includes: the acquisition control server configuring the test information of the test equipment corresponding to the target application; the data analysis server analyzing the parameter information uploaded corresponding to the target application; judging that the parameter information belongs to the test equipment When the parameter information belonging to the test equipment is analyzed in real time; when the report generating server judges that the parameter information belongs to the test equipment, a data report is generated in real time according to the data analysis result.

Wherein, the acquisition control server 102 includes: a development configuration server 1024; the development configuration server is configured to configure at least one test identification of a test device for the target application after the target application is registered; Configure the collection parameters to be tested, and use the test identification and collection parameters as test information; the data analysis server is also used to obtain the parameter information of the target application corresponding to the collection parameters from the uploaded parameter information; through the parameter information The terminal parameter corresponds to the terminal identifier; judge whether the terminal identifier is the same as the test identifier in the test equipment table, and when the terminal identifier is the same as any test identifier in the test equipment table, it is judged that the parameter information belongs to the test equipment.

Configuring the test information of the test device corresponding to the target application includes: after the target application completes registration, configuring the test identification of at least one test device for the target application; configuring the acquisition parameters to be tested for the target application, and The test identification and the collection parameters are used as the test information; the method further includes: the data analysis server obtains the parameter information of the target application corresponding to the collection parameters from the uploaded parameter information; through the terminal parameters corresponding to the terminal identification in the parameter information; judging Whether the terminal identifier is the same as the test identifier in the test equipment table, and when the terminal identifier is the same as any test identifier in the test equipment table, it is judged that the parameter information belongs to the test equipment.

The data analysis server 104 is further configured to search the verification information corresponding to the verification parameters from the parameter information; analyze the verification information to determine a hijacking verification result.

The method further includes: the data analysis server searches the parameter information for verification information corresponding to the verification parameter; and analyzes the verification information to determine a hijacking verification result.

The data analysis server 104 is configured to determine the parameter identification of the verification parameter, and search the verification information corresponding to the parameter identification from the parameter information; detect whether the verification information is target information; if the verification information If it is not the target information, it is determined that there is a hijacking exception in the traffic, and the hijacking exception is recorded in the hijacking verification result; if the verification information is the target information, it is determined that the data transmission is normal, and the transmission is recorded in the hijacking verification result as normal.

Finding the verification information corresponding to the verification parameter from the parameter information; analyzing the verification information to determine the hijacking verification result, including: determining the parameter identification of the verification parameter, and searching the parameter identification from the parameter information Corresponding to the verification information; detecting whether the verification information is the target information; if the verification information is not the target information, determine that there is a hijacking exception in the flow, and record the hijacking exception in the hijacking verification result; if the verification The information is the target information, it is determined that the data transmission is normal, and the transmission is recorded in the hijacking verification result as normal.

The data analysis server 104 is further configured to search the storage information corresponding to the storage parameters from the parameter information; detect data quality according to the storage information, and determine a quality verification result.

The method further includes: the data analysis server searches the parameter information for storage information corresponding to the storage parameters; detects data quality according to the storage information, and determines a quality verification result.

The data analysis server 104 is configured to determine the storage identifier of the storage parameter, and search the storage information corresponding to the storage identifier from the parameter information; search for at least one terminal identifier according to the storage information; when the storage information corresponds to a terminal ID to generate a quality verification result of qualified quality; when the stored information corresponds to more than one terminal ID, search for the successfully uploaded information corresponding to the terminal ID; sort the upload success information corresponding to each terminal ID, and determine the When there is no redundancy in the successful upload information, it is judged that the data is abnormal, and the quality verification result of the abnormal data is generated.

Find the storage information corresponding to the storage parameter from the parameter information; detect the data quality according to the storage information, and determine the quality verification result, including: determining the storage identification of the storage parameter, and searching for the storage identification corresponding to the storage from the parameter information information; search for at least one terminal identifier based on the stored information; when the stored information corresponds to a terminal identifier, generate a qualified quality verification result; when the stored information corresponds to more than one terminal identifier, search for the corresponding terminal identifier Successfully uploading information; sorting the successfully uploaded information corresponding to each terminal identifier, and determining that the uploaded successfully information has no redundancy according to the sorting result, judging that the data is abnormal, and generating a quality verification result of the abnormal data.

As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other device. Various generic systems can also be used with the teachings based on this. The structure required to construct such a system is apparent from the above description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all components in the data acquisition and testing device according to the embodiment of the present invention. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

The invention discloses A1. A data collection and testing method, comprising:

receiving the uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running;

Searching for storage information corresponding to storage parameters from the parameter information;

Data quality is detected according to the stored information, and a quality verification result is determined.

A2. The method as described in A1, searching the storage information corresponding to the storage parameter from the parameter information, including:

Determine the storage ID of the storage parameter, and search for the storage information corresponding to the storage ID from the parameter information.

A3, the method as described in A2, according to the stored information to detect data quality, determine the quality verification result, including:

Find at least one terminal identifier according to the stored information;

The terminal identification is used to detect data quality, and the quality verification result is determined.

A4, the method as described in A3, adopt described terminal mark to detect data quality, determine quality verification result, comprise:

When the stored information corresponds to a terminal identifier, generate a qualified quality verification result;

When the stored information corresponds to more than one terminal identifier, a quality verification result of abnormal data is generated.

A5, the method as described in A4, also includes:

When there is more than one terminal identifier in the terminal identifier, search for the successful upload information corresponding to the terminal identifier;

Sort the upload success information corresponding to each terminal identifier;

When it is determined according to the sorting result that there is no redundancy in the upload success information, it is determined that the data is abnormal.

A6. The method described in any one of A1 to A5, wherein the storage parameters include: secure digital storage SD card parameters, and the storage information corresponding to the storage parameters includes: SD card information.

The present invention also discloses B7, a data collection and testing device, comprising:

A parameter information receiving module, configured to receive uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running;

A storage information search module, configured to search the storage information corresponding to the storage parameters from the parameter information;

A data quality detection module, configured to detect data quality according to the stored information, and determine a quality verification result.

B8. The device according to B7, wherein the storage information search module is specifically configured to determine a storage identifier of a storage parameter, and search the storage information corresponding to the storage identifier from the parameter information.

B9, the device as described in B8, the data quality detection module includes:

A terminal identification search submodule, configured to search for at least one terminal identification according to the stored information;

The quality verification sub-module is configured to use the terminal identification to detect data quality and determine a quality verification result.

B10, the device as described in B9, the quality checking submodule, comprising:

A qualified result generating unit, configured to generate a qualified quality verification result when the stored information corresponds to a terminal identifier;

The abnormal result generating unit is configured to generate a quality verification result of data abnormality when the stored information corresponds to more than one terminal identifier.

B11. The device as described in B10, further comprising:

An upload information search module, configured to search for successfully uploaded information corresponding to the terminal identifier when there is more than one terminal identifier in the terminal identifier;

The information sorting module is used to sort the successful upload information corresponding to each terminal identifier;

An abnormality judging module, configured to judge data abnormality when it is determined that there is no redundancy in the successful upload information according to the sorting result.

B12. The device according to any one of B7 to B11, wherein the storage parameters include: secure digital storage SD card parameters, and the corresponding storage information of the storage parameters includes: SD card information.

Claims (10)

1. A data collection test method, comprising: receiving the uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running; Searching for storage information corresponding to storage parameters from the parameter information; Data quality is detected according to the stored information, and a quality verification result is determined. 2. The method according to claim 1, wherein searching the storage information corresponding to the storage parameters from the parameter information comprises: Determine the storage ID of the storage parameter, and search for the storage information corresponding to the storage ID from the parameter information. 3. The method according to claim 2, characterized in that, detecting data quality according to the stored information and determining the quality verification result include: Find at least one terminal identifier according to the stored information; The terminal identification is used to detect data quality, and the quality verification result is determined. 4. The method according to claim 3, characterized in that, using the terminal identification to detect data quality and determining the quality verification result comprises: When the stored information corresponds to a terminal identifier, generate a qualified quality verification result; When the stored information corresponds to more than one terminal identifier, a quality verification result of abnormal data is generated. 5. The method of claim 4, further comprising: When there is more than one terminal identifier in the terminal identifier, search for the successful upload information corresponding to the terminal identifier; Sort the upload success information corresponding to each terminal identifier; When it is determined according to the sorting result that there is no redundancy in the upload success information, it is determined that the data is abnormal. 6. The method according to any one of claims 1 to 5, wherein the storage parameters include: secure digital storage SD card parameters, and the storage information corresponding to the storage parameters includes: SD card information. 7. A data collection test device, comprising: A parameter information receiving module, configured to receive uploaded parameter information, wherein the parameter information is collected for each collection parameter when the application is running; A storage information search module, configured to search the storage information corresponding to the storage parameters from the parameter information; A data quality detection module, configured to detect data quality according to the stored information, and determine a quality verification result. 8 . The device according to claim 7 , wherein the storage information search module is specifically configured to determine a storage identifier of a storage parameter, and search the storage information corresponding to the storage identifier from the parameter information. 9. The device according to claim 8, wherein the data quality detection module comprises: A terminal identification search submodule, configured to search for at least one terminal identification according to the stored information; The quality verification sub-module is configured to use the terminal identification to detect data quality and determine a quality verification result. 10. The device according to claim 9, wherein the quality checking submodule comprises: A qualified result generating unit, configured to generate a qualified quality verification result when the stored information corresponds to a terminal identifier; The abnormal result generating unit is configured to generate a quality verification result of data abnormality when the stored information corresponds to more than one terminal identifier.