Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method and a device for consistency verification of power operation data based on an end cloud collaborative service, which are used for consistency verification of cloud and source end power operation data.
The technical scheme adopted by the invention is as follows:
The invention provides a power operation data consistency verification method based on an end cloud cooperative service, which comprises the following steps:
transmitting the station and time period information of the appointed verification to a source terminal;
detecting the power operation data of the factory station with specified verification according to a preset detection rule and calculating an information abstract at the same time of the cloud end and the source end; the source end is a system for providing power operation data, and the cloud end is a system for collecting data;
Consistency comparison is carried out on the source information abstract and the cloud information abstract,
If the information abstracts are inconsistent, a conclusion that the power operation data of the cloud end and the power operation data of the source end are inconsistent is obtained, the cloud end data are corrected, and the verification is finished;
if the information abstract is consistent, consistency comparison is carried out on the source end detection result and the cloud end detection result,
If the detection results are inconsistent, a conclusion that the detection rules of the cloud end and the source end are inconsistent is obtained, the detection rules of the source end are corrected, and the verification is finished; if the detection results are consistent, the verification is successful, a conclusion that the power operation data of the cloud end and the power operation data of the source end are consistent is obtained, and the verification is finished.
Further, the predetermined detection rule is as follows:
Further, the detecting the power operation data of the station with the specified verification and calculating the information abstract includes:
reading all power operation data in a station appointed time period appointed for verification;
Performing deletion detection, unchanged detection, jump detection, bus unbalance detection, electric consistency detection and line unbalance detection on the read power operation data according to a preset detection rule to generate a detection result;
sequencing the detection results according to the station identification and the starting time, and controlling the numerical accuracy of the detection results;
And adopting an MD5 algorithm and an SHA1 algorithm to calculate the information abstract for the detection result after normalization processing.
Further, the detection result and the information abstract are described in an E format.
Further, the modifying cloud data includes:
acquiring power operation data of a source end;
Comparing the power operation data of the cloud end and the power operation data of the source end to find out differences;
and correcting cloud data according to the comparison difference.
Further, the correcting the source end detection rule includes:
Acquiring a source end data detection rule;
Comparing the detection rules of the cloud end and the source end to find out the difference;
And sending the difference information of the detection rules of the cloud end and the source end to the source end, and updating the data detection rules of the source end.
The invention also provides a device for checking the consistency of the power operation data based on the end cloud cooperative service, which comprises the following steps:
The cloud coordination module is used for sending the factory station and time period information of the appointed verification to the source end; consistency comparison of the source information abstract and the cloud information abstract is carried out; consistency comparison of the source end detection result and the cloud end detection result is carried out; correcting cloud data through comparison and searching for detection rule differences through comparison;
the cloud data verification module is used for detecting the power operation data of the station, which is specified and verified by the cloud, according to a preset detection rule and calculating an information abstract according to a detection result;
the source terminal data verification module is used for detecting the power operation data of the station appointed to be verified by the source terminal according to a preset detection rule and calculating an information abstract according to a detection result;
the algorithm rule updating module is used for updating the source end detection rule according to the difference between the cloud end detection rule and the source end detection rule issued by the cloud end cooperative module.
Furthermore, the cloud data verification module and the source data verification module are specifically used for,
Reading all power operation data in a station appointed time period appointed for verification;
Performing deletion detection, unchanged detection, jump detection, bus unbalance detection, electric consistency detection and line unbalance detection on the read power operation data according to a preset detection rule to generate a detection result;
sequencing the detection results according to the station identification and the starting time, and controlling the numerical accuracy of the detection results;
And adopting an MD5 algorithm and an SHA1 algorithm to calculate the information abstract for the detection result after normalization processing.
Furthermore, the cloud collaboration module is specifically configured to,
Acquiring power operation data of a source end;
Comparing the power operation data of the cloud end and the power operation data of the source end to find out differences;
and correcting cloud data according to the comparison difference.
Furthermore, the cloud collaboration module is specifically configured to,
Acquiring a source end data detection rule;
Comparing the detection rules of the cloud end and the source end to find out the difference;
And sending the difference information of the detection rules of the cloud end and the source end to the source end.
The beneficial effects of the invention are as follows:
according to the method and the device, the power operation data of the station are detected at the same time of the cloud end and the source end, so that the calculation resources of the source end are effectively utilized, and the cloud end calculation pressure is relieved.
The invention adopts the information abstract mode to compare the data consistency, avoids the transmission of a large amount of data, compares the service calling data under the condition that the information abstracts are inconsistent, realizes the consistency check and correction of massive power operation data, effectively saves network resources and improves the data comparison efficiency.
According to the method, the reason of the inconsistency of the data can be effectively and primarily judged through comprehensive judgment by combining the data rationality detection result and the information abstract, and the quality management level of the power operation data in the cloud computing environment is assisted to be improved.
Detailed Description
The invention is further described below. The following examples are only for more clearly illustrating the technical aspects of the present invention, and are not intended to limit the scope of the present invention.
The cloud end and the object end are contained in a computing environment with the cooperation of the end cloud, a multi-level architecture is arranged in an electric power regulation cloud architecture, the multi-level architecture comprises a national regulation cloud, a provincial regulation cloud, a dispatching automation system at each level and a station monitoring system, the method is suitable for operation data consistency check among the levels, the operation data consistency check of the national regulation cloud and the provincial regulation cloud is taken as an example for better describing the scheme, and a system for providing data is called a source end and a system for collecting data for avoiding ambiguity is called a cloud end.
Referring to fig. 1, in the power regulation cloud, one cloud corresponds to a plurality of source ends, data of the cloud is uploaded and stored in the cloud by the source ends, and the consistency check of the power operation data based on the end cloud collaborative service is to compare and check the power operation data respectively stored in the cloud and the source ends to find inconsistent data, and the data detection rules are formulated and issued by the cloud.
According to the invention, the consistency check of the power operation data is carried out by taking the plant as a unit according to the plant range division data, and the method comprises the steps of data detection, information abstract generation, information abstract comparison and detection result comparison. The data detection comprises deletion detection, unchanged detection, jump detection, bus imbalance detection, electric consistency detection and line imbalance detection.
The embodiment of the invention provides a power operation data consistency verification method based on an end cloud cooperative service, which is shown in fig. 2 and comprises the following steps:
(1) And starting to execute the power grid operation data in a specified time period of a certain plant. The cloud designates the station and time to be checked, and sends the station identification and time period information to the source terminal.
The method specifically comprises the following steps: the cloud starts the source detection process by calling the source data detection service, and the service calling parameters include (start time, end time, station identifier) as shown in table 1 below.
Table 1 cloud invocation parameters
| Parameter name |
Parameters (parameters) |
Value of |
| Start time |
Begin_time |
2020-1-1 |
| End time |
End_time |
2020-2-1 |
| Station identification |
Station_id |
21033022456234 |
(2) The cloud end and the source end execute the following data verification according to a preset detection rule at the same time:
(21) Reading all power operation data in a specified time period of a certain plant station;
(22) And carrying out data detection on the read power operation data according to a preset detection rule, wherein the detection comprises deletion detection, unchanged detection, jump detection, bus unbalance detection, electric consistency check and line unbalance check, and generating a detection result.
The detection result is described in an E format:
(23) And (3) carrying out standardization processing on the detection result of the power operation data, wherein the standardization processing comprises sequencing according to two of the station identification and the starting time, controlling the floating point number precision and reserving 2-bit decimal.
(24) And calculating the information abstract by adopting an MD5 algorithm and an SHA1 algorithm on the normalized data, and generating the information abstract.
The information abstract result is described in an E format:
In the invention, the data detection rules are uniformly formulated and issued by the cloud, and the detection rules are described as follows:
table 2 rule of detection
(3) And the source end sends the detection result and the information abstract to the cloud end.
(4) And (3) performing consistency comparison between the source information abstract and the cloud information abstract at the cloud, and if the information abstracts are inconsistent, performing the step (5), otherwise, performing the step (6). Consistency comparison of the information abstracts is to check whether the abstracted character strings are identical.
(5) And (3) obtaining a conclusion that the cloud power operation data are inconsistent, comparing the cloud call source data to find out difference data, and correcting the cloud data through comparison to finish verification.
The source data is described in the E format:
(6) And comparing the source end detection result with the cloud end detection result at the cloud end.
If the verification results are inconsistent, obtaining a result of inconsistent end cloud detection rules, and comparing cloud call detection rules to find differences, wherein the method comprises the following steps: the comparison refers to whether the same measurement comparison val is found through the measurement_id and SAMPLE TIME for the detection result.
(61) The cloud calls a source end data detection rule;
(62) The source end sends the detection rule to the cloud end;
(63) Comparing the detection rules to form difference information;
(64) And sending the difference information to the source terminal, and updating the source terminal detection rule.
And if the cloud power operation data is not consistent, the verification is successful, and a conclusion that the cloud power operation data is consistent is obtained, and the verification is finished.
The embodiment of the invention provides a power operation data consistency verification method based on an end cloud cooperative service, which effectively utilizes source computing resources to relieve cloud computing pressure by issuing a function of enabling source load data rationality detection through algorithm sinking and rules. The data consistency is compared by adopting a double information abstract mode, so that the transmission of a large amount of data is avoided, the comparison is performed through the service calling data under the condition that the information abstracts are inconsistent, the network resources are effectively saved, and the data comparison efficiency is improved. The reason of the data inconsistency can be effectively and primarily judged through comprehensive judgment of the combination of the data rationality check result and the information abstract, and the power operation data quality management level in the cloud computing environment is assisted to be improved.
The embodiment of the invention also provides a device for checking the consistency of the power operation data based on the end cloud cooperative service, which referring to fig. 3, comprises the following steps:
the cloud coordination module is used for sending the station identification and time period information of the designated check station and time to the source terminal; consistency comparison of the source information abstract and the cloud information abstract is carried out; consistency comparison of the source end detection result and the cloud end detection result is carried out; correcting cloud data through comparison and searching for end cloud detection rule differences through comparison;
the cloud data verification module is used for detecting the power operation data of the station specified and verified by the cloud and calculating an information abstract according to the detection result;
The source terminal data verification module is used for detecting the power operation data of the station of the designated verification of the source terminal and calculating an information abstract according to the detection result;
and the algorithm rule updating module is used for updating the source end detection rule according to the difference of the end cloud detection rules issued by the cloud coordination module.
In this embodiment, the cloud end data verification module and the source end data verification module are specifically configured to,
Reading all power operation data in a station appointed time period appointed for verification;
Performing deletion detection, unchanged detection, jump detection, bus unbalance detection, electric consistency detection and line unbalance detection on the read power operation data according to a preset detection rule to generate a detection result;
sequencing the detection results according to the station identification, time and controlling the numerical precision of the detection results;
And adopting an MD5 algorithm and an SHA1 algorithm to calculate the information abstract for the detection result after normalization processing.
In this embodiment, the cloud end collaboration module is specifically configured to,
Acquiring power operation data of a source end;
Comparing the power operation data of the cloud end and the power operation data of the source end to find out differences;
and correcting cloud data according to the comparison difference.
And
Acquiring a source end data detection rule;
Comparing the detection rules of the cloud end and the source end to find out the difference;
And sending the difference information of the detection rules of the cloud end and the source end to the source end.
It should be noted that the embodiment of the apparatus corresponds to the embodiment of the method, and the implementation manner of the embodiment of the method is applicable to the embodiment of the apparatus and can achieve the same or similar technical effects, so that the description thereof is omitted herein.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical aspects of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the above embodiments, it should be understood by those of ordinary skill in the art that: modifications and equivalents may be made to the specific embodiments of the invention without departing from the spirit and scope of the invention, which is intended to be covered by the claims.