Log based computer system fault diagnosis method and device

Abstract

The invention discloses a log management and fault diagnosis method and device under multiple hosts. The method comprises fault log collection, fault log analysis and fault log correlation analysis. Fault log collection comprises collecting fault logs of all hardware and software in the cluster and storing the logs in a log server uniformly. Fault log analysis comprises filtering the fault logs, extracting log template information and classifying the logs according to log types. Fault log correlation analysis comprises performing fault reason analysis by using log analysis results and combining time windows, clustering the related faults caused by the same fault into a category and trying to find the root of the type of the faults. The method and the device are capable of analyzing the system operation condition effectively, assisting administrators to process system faults and improving the fault type determination accuracy.

Description

technical field [0001] The invention belongs to the field of fault analysis under computer system reliability, and more specifically relates to a log-based computer system fault diagnosis method and device. Background technique [0002] With the introduction of cloud computing structure, computer systems have become more and more complex, and the software operating on them has become more and more abundant, with more frequent interactions and high coupling, making it difficult to analyze the causes and types of system failures. In order to solve the stringent requirements of some critical applications on system processing power and fault tolerance, it is necessary to monitor and record its daily behavior. So that after an error occurs, the fault can be diagnosed and located in time, and the cause of the fault can be found out, so as to repair the system error, improve the system performance, and ensure that similar faults will not happen again. [0003] In a complete inform...

AI Technical Summary

Problems solved by technology

[0006] (1) Requires a lot of manual intervention

Since the fault diagnosis of log classification is centered on human judgment, it is difficult to obtain the desired results solely by automatic processing of computers.

Therefore, the traditional fault diagnosis system often relies on the expert system, which requires a lot of manual processing to pass through the basic data set. The computer will produce a relatively ideal result after a long period of learning and correction, which wastes a lot of system administrators. time;

[0007] (2) Slow response speed

The current analysis system is usually based on a complex set of judgment modes, and it is difficult to respond to the faults in the system in real time;

[0008] (3) Low accuracy

The accuracy of classifying logs is often low, and there is a lack of algorithms for correcting misjudgments

Images