JPH10312323A - Statistical processing device for log information - Google Patents

Abstract

(57) [Summary] [Problem] Other server administrators or users who do not have access authority to a specific server can immediately see the log information, the log information of other related servers, and their processing information. To provide a statistical information processing apparatus for log information capable of greatly reducing the time required for analyzing a large amount of data. A log data collection unit (510) stores various servers (WWW server 10) when traffic is low, such as at midnight.
0, proxy server 200, News server 300, helpdesk
The log information on the server 400) is collectively collected and stored in the platform 520. The data processing unit 530 includes:
Statistical processing for processing the data set on the platform 520 is performed, and the data set is stored in the storage unit 540. GUI
If a data set on the platform is specified by the unit 570 and a desired statistical processing analysis is specified by the analyzing unit 560, a detailed statistical processing result can be obtained.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a statistical processing apparatus for an intra-company communication service, and more particularly, to a system administrator who collects / processes log information on various services constituting an intra-company communication service and collects / processes the information. And users have WWW (Wor
The present invention relates to a statistical information processing apparatus for log information, which is capable of obtaining a statistical display result by a browser and directly analyzing log information.

[0002]

2. Description of the Related Art FIG. 5 is a diagram showing a management relationship between various servers and server managers in the prior art. As shown in the figure, log information httpd.log is stored on the WWW server 100.
Exists, and the WWW server administrator 150
00 is managed. The log information proxy.log exists on the proxy server 200, and the proxy server administrator 250
The server 200 is managed. The log information syslog exists on the News server 300, and the News server administrator 350
Manages the News server 300. log information Trb on helpdesk server 400 Logde exists and helpde
The sk server administrator 450 manages the helpdesk server 400. As described above, in the related art, various servers and an administrator who has access authority to the various servers have a one-to-one correspondence.

[0003] More specifically, various servers (WWW server 100, pr
The log information collected by the oxy server 200, the News server 300, and the helpdesk server 400 is stored in a server administrator (WWW server administrator 15) having access authority for each server.
0, proxy server administrator 250, News server administrator 35
0, helpdesk server administrator 450), and an administrator with access authority collects the log information as needed, processes it, and displays it.

[0004]

As described above, in the prior art, each server administrator can access / collect only the server to which he / she has access authority and collect / process log information. Could not be accessed at all for servers that do not have. Therefore,
Log information of various servers can be collected / processed only by a server administrator having access authority, and a server administrator without access authority cannot collect / process the log information. Therefore, even when similar processing is performed on log information of various servers, there is a problem that a server administrator having access authority to the server must individually perform processing.

In addition, data related to different servers cannot be mutually collected / processed, and statistics display cannot be seen in principle except for those who have access authority to the servers. Furthermore, there is a problem that it takes a very long time if each server administrator performs a complicated statistical analysis process on a large amount of data.

An object of the present invention is to allow other server administrators or users who do not have access authority to a specific server to immediately view the log information, the log information of other related servers, and the processing information thereof. It is another object of the present invention to provide a statistical information processing apparatus for log information which can significantly reduce the time required for analyzing a large amount of data.

[0007]

SUMMARY OF THE INVENTION A statistical processing apparatus of the present invention collectively collects all log information of various servers on which a statistical processing apparatus is to be statistically displayed, and provides various server managers and users with information. Process the basic data to display the desired statistics, perform a series of these processes in a batch process during off-peak periods such as nighttime, and accumulate the processed basic data by having the statistical processing device function as a WWW server. by doing,
Even users who do not have access rights to various servers can access http (hy
per text transfer protocol) so that you can see the result of statistical processing. Furthermore, if you want to obtain detailed analysis results other than those provided via http, you can also obtain them by directly manipulating the base data.

More specifically, the statistical processing device (500) of the present invention comprises a log information collection unit (510), a platform (520), a data processing unit (530), a storage unit (540), and an analysis unit (560). ). The log data collection unit (510) includes various servers (WWW server 100, proxy server 200, Ne
The log information on the ws server 300 and the helpdesk server 400 is collectively collected and stored in the platform (520). On the other hand, the data processing unit (530) performs statistical processing for processing the data set on the platform (520) to provide basic data to be provided to various server administrators and users (600) as a statistical display service on the WWW, and accumulates the data. (540).

The statistical processing device (500) executes the above processing every off-peak period, such as at midnight. Therefore, the processing up to the provision of the statistical display service between the various servers can be automatically realized every day with the latest data. The latest statistical display results can be obtained every day by performing a normal operation without being aware of. Also,
From the GUI unit (570), the desired platform (52
0) If the data set above is specified and a desired statistical processing analysis is specified from the analysis unit (560), a detailed statistical processing result can be obtained.

According to the statistical information processing apparatus for log information of the present invention, various server managers and users do not need to directly access various servers, and various processing information is stored in WW.
Provided as a statistical display service by the W browser, the latest statistical display result can be obtained instantly by selecting it, and more detailed analysis can be performed by directly operating from the GUI unit of the present invention device Become.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a diagram for explaining a configuration diagram and an environment of a statistical processing device according to an embodiment of the present invention, and shows various services (WWW server 100, proxy server 200, News server 300, helpdesk) in an in-company communication service. A log data collection unit 510 that collects log information from the server 400), and a platform 52 that converts the collected log information into a data set and stores it.
0 and the data sets stored in the platform 520 are stored in various server administrators (WWW server administrators 150, pr
The data processing unit 530 that processes the oxy server administrator 250, the News server administrator 350 (omitted in FIG. 2), the helpdesk server administrator 450 (omitted in FIG. 2), and the user 600 to provide them as a statistical display service. And a storage unit 5 that stores the data after processing by the data processing unit 530
40, a statistical processing device 500 including a GUI unit 570 (to be described later), and a statistical processing device manager 550 that receives a notification when the log data collection unit 510 fails to collect log information. .

FIG. 2 shows a flowchart of batch processing (collecting, processing, and accumulating various log information) performed by the statistical processing apparatus according to one embodiment of the present invention. First, the statistical processing device 500 is started by the AT command when the system traffic is low (for example, every midnight) (step: S100). The log data collection unit 510 in the statistical processing device 500 acquires log information httpd.log on the WWW server 100 by ftp (file transfer protocol) (step: S110), and notifies the statistical processing device 550 when the acquisition has failed. (Step: S19
0).

If the acquisition of the log information httpd.log succeeds, the log data collection unit 510 then proceeds to the proxy server 2
The log information proxy.log on 00 is acquired by ftp (step: S120), and if the acquisition fails, the statistics processing device manager 550 is notified (step: S190). If the acquisition of the log information proxy.log is successful, the log data collection unit 510 then proceeds to the log information syslog on the News server 300.
g is collected by ftp (step: S130), and if acquisition fails, the statistical processing device manager 550 is notified (step: S190).

If the acquisition of the log information syslog is successful, the log data collection unit 510 then proceeds to the helpdesk server 400
The above log information Trb ODBC to LogDB (Open Data
Access is made via Base Connection, and log information is collected (step: S140). If the access fails, the statistical processing device manager 550 is notified (step: S190).
When the acquisition of the log information is successful, all the acquired log information is accumulated in the platform 520 as an intermediate file (Step: S150).

Thereafter, the intermediate file stored in the platform 520 is converted into a data set for processing (being basic data for performing statistical processing) (step:
S160). The converted data set is subjected to necessary statistical processing, and the result is stored in the storage unit 540 in the form of a diagram and a table in a format corresponding to the menu of the statistical display service (step: S170). When the storage in the storage unit is completed, the intermediate file is deleted (step: S
180).

FIG. 3 shows an embodiment of the present invention.
5 shows a flowchart of the side using the statistical display service by W. Various server administrators 150, 25
0, 350, 450 or the user 600 activates a WWW browser and selects an appropriate URL (Uniform Resource L.).
ocator), an initial screen of the statistical processing display service is displayed (step: S200). further,
Since various statistics display services are provided in the menu on the screen, various server administrators 150, 250,
The user 350 or 450 or the user 600 selects a desired service (statistical display result) (step: S210).
The latest data is reflected on the selected statistics display screen (step: S220). For example, if the processing shown in FIG. 3 is performed every midnight, all data up to yesterday is reflected.

FIG. 4 shows various server administrators 150 and 25.
9 is a flowchart for explaining an embodiment in which a detailed analysis is performed by the user 0, 350, 450 or the user 600 directly operating the statistical processing device. Various server administrators 150, 250, 350, 450 or users 60
0 is a GUI section (Graphical User Interface section) 5
70, a desired data set on the platform 520 and a statistical analysis processing method are designated (step: S30).
0). The analysis unit 560 performs a process on the specified data set according to the specified statistical analysis processing method, and displays the result on the GUI unit (step:
S310).

Further, it is determined whether or not another statistical analysis process is necessary (step: S320). If not, the detailed analysis is terminated (step: S340). If it is determined that another statistical analysis process is necessary, it is next determined whether or not analysis on another data set is necessary (step: S)
330) If not necessary, return to step: S310,
Perform another analysis on the selected dataset.

In step S330, if it is necessary to analyze another data set, step S3
00, and again, various server administrators 150, 250,
350, 450 or the user 600 designates a desired data set on the platform 520 and a statistical analysis processing method (step: S300);
The processing after 310 is repeated.

As described above, conventionally, each server administrator (WWW, Proxy, News, helpdesk) individually logs on to each server as necessary and performs necessary statistical processing based on log information. Thus, according to this embodiment, the statistical processing apparatus automatically collects the latest information when traffic is low (for example, every midnight) and analyzes it in detail. In addition, by providing the result of performing statistical processing that is typically required as a statistical display service on a WWW server, the burden on various server administrators can be reduced, and other server administrators can exchange other servers with each other. Can be obtained. Also, by providing the service as a service on the WWW, even a user who does not have access authority to various servers can freely obtain a statistical display result from the WWW browser. In addition, when traffic is low (for example, every midnight), the statistics display service that reflects the latest data is automatically provided, so there is almost no burden on various server administrators, and as long as there is no abnormality in collecting log information, This can be realized with almost no burden on the administrator of the statistical processing device.

[0021]

According to the statistical information processing apparatus for log information of the present invention, other server administrators or users who do not have access authority to a specific server can also obtain the log information, the log information of other related servers, and the like. The processing information can be immediately viewed, and the time required to analyze a large amount of data can be significantly reduced.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a statistical processing apparatus and an environment for explaining the environment according to an embodiment of the present invention;

FIG. 2 is a diagram illustrating a flowchart of a batch process performed by the statistical processing device according to the embodiment of the present invention.

FIG. 3 is a flowchart of using a statistical display service by WWW in the embodiment of the present invention.

FIG. 4 is a flowchart for performing detailed analysis using the statistical processing device according to the embodiment of the present invention.

FIG. 5 is a diagram showing a management relationship between various servers and each server administrator in the related art.

[Explanation of symbols]

 100: WWW server 150: WWW server administrator 200: proxy server 250: proxy server administrator 300: News server 350: News server administrator 400: helpdesk server 450: helpdesk server administrator 500: statistical processing device 510: log data collection Unit 520: Platform 530 Data processing unit 540: Storage unit 550: Statistical processing device administrator 560: Analysis unit 570: GUI unit 600: User

Claims (7)

[Claims] 1. A log data collecting unit for collecting log information on various servers constituting an intra-company communication service, a platform for converting collected data into a data set and storing the data set, and processing the stored data set. The data processing unit stores the processed data and stores the processed data in WWW (World Wi
A storage unit that displays the processing results to various server managers and other users on de Web), and a GUI that specifies the desired data set and analysis method and obtains detailed analysis results by directly analyzing the data set (Graphical Usente
(rface) unit and an analysis unit having a plurality of statistical analysis processing methods. 2. The log data collection unit collects log information from various servers when traffic is low, and notifies the statistical processing device administrator of the failure if the collection fails, and stores the log information in an intermediate file if the collection is successful. The statistical information processing apparatus for log information according to claim 1, wherein the statistical information is converted and stored in the platform. 3. The platform has a function of converting an intermediate file accumulated by the log data collection unit into a data set for analysis / processing and a function of storing the converted data set. The statistical information processing apparatus for log information according to claim 1. 4. The data processing unit performs a statistical process on the data set converted by the platform to provide various statistical displays to various server administrators and users. The log information according to any one of claims 1 to 3, further comprising: means for accumulating the data in the accumulating unit; and means for deleting all the intermediate data on the platform when all the processes are completed. Statistical processing equipment. 5. The storage unit according to claim 1, wherein the storage unit has means for providing processing results stored by the data processing unit to various server administrators and users via WWW.
5. The statistical information processing device for log information according to any one of items 4 to 4. 6. The GUI unit performs means for selecting a desired data set and a statistical analysis processing method stored in the platform, and performs a selected statistical analysis processing method on the selected data set. 6. The statistical information processing apparatus for log information according to claim 1, further comprising means for displaying a result. 7. The analysis unit according to claim 1, wherein the analysis unit includes means for analyzing the data set selected by the GUI unit using a selected statistical analysis processing method. The statistical information processing apparatus for log information according to claim 1.