System and method for remotely collecting, retrieving and displaying application system logs

Abstract

The invention provides a system and a method for remotely collecting, retrieving and displaying application system logs. The method comprises the following steps: installing a server-side system (LogServer for short) and services needing to collect logs on the same machine, and configuring a LogServer log collecting directory as a directory for generating logs for the services; adding servers needing to collect logs into any terminal running client system (LogViewer for short) in order to retrieve corresponding logs according to certain conditions. The server-side system comprises a log index module, a log retrieval module, a log compression module and a log transmission module. The client system comprises a request preprocessing module, a request processing module, a local log caching and maintenance module, a log retrieval module and an information display module. By adopting the system and the method, the locating and solving efficiencies of application system problems can be increased greatly, the running and maintenance costs of an application system are lowered effectively, and the completeness and reliability of the application system are improved.

Description

technical field [0001] The present invention relates to a log collection system and method, in particular to a system and method for remotely collecting, retrieving and displaying application system logs, especially a high-performance remote log retrieval method and a flexible filtering and display scheme for massive logs. Background technique [0002] Logging is an indispensable function of almost all application systems. In order to ensure the traceability and recoverability of application system errors, we often record a large number of logs to effectively check and monitor the operation of the system, and quickly locate the problems that occur in the operation of the system. question. For a large number of logs, how to quickly and efficiently retrieve logs, especially for those servers deployed in places where operation and maintenance personnel are difficult to access, how to collect and retrieve logs remotely is a particularly prominent problem. [0003] In the prior ...

AI Technical Summary

Problems solved by technology

[0004] 1) Local log collection: directly collect the running logs of the service on the host where the application service is deployed. It is often very difficult to deploy on-site environments, especially for environments such as coal mines, steelmaking, and highway toll stations; secondly, for those problems that require dynamic monitoring and retrieval of logs to find system error patterns, it is often impossible to pass the user Provide log information in real time, which requires our product development and maintenance personnel to go to the site to dynamically observe and analyze the logs, which undoubtedly increases a lot of extra costs; once again frequently entering the site to view logs, analyzing problems also increases users' distrust of the product ;

[0005] 2) Simple remote log collection: by adding a log acquisition function module to the application system, and then obtaining logs through a specific terminal, when this solution is implemented, it can only be refined to obtain all logs of a specific module or logs of a certain day. Due to the lack of effective It usually takes a lot of time and takes up a lot of network bandwidth to obtain a large number of logs generated when the system is abnormal, and it is impossible to dynamically monitor the abnormal logs of specified conditions in real time, which is especially important for problems that need urgent repairs on site. inefficient

[0007] This patent provides a method for obtaining log information of remote terminals, but each request can only return all log information, and cannot incrementally return the latest log records. For monitoring service operation through remote real-time dynamic monitoring system service logs The efficiency of the demand is very poor, or even unable to meet the demand, because it does not provide an effective incremental request mechanism and an efficient retrieval algorithm to reduce the number of records for each log request, thereby reducing the bandwidth occupied by network transmission and providing remote access to terminals. log efficiency

Images