Log recording method, log inquiring method and system

Abstract

The invention provides a log system. The system comprises a log recording device and a log inquiring device. According to the log recording device, a recording unit records a shift quantity of a writing position of a log to a starting position of a log data file; and an index file writing unit writes a field value of every field, the log shift quantity and / or log length into corresponding index files in a correlating mode. According to the log inquiring device, a log shift quantity acquiring unit reads all log shift quantities which meet separate inquiring conditions from the corresponding index files according to a plurality of inquiring conditions; an intersection calculating unit calculates intersections of the read log shift quantities; and a log reading unit reads logs which meet the inquiring conditions from a log data file according to the log shift quantities in the intersections. By using the log system, the inquiring performance of the logs can be obviously improved, and storage space occupied by the index files can be reduced.

Description

technical field [0001] The present invention relates to the field of log processing, and more specifically, to a log recording method and device, a log query method and device, and a log system with the device. Background technique [0002] The log system is responsible for receiving the log data sent by the gateway, storing the received log data in a certain format, and providing the query function for the log data. The log data sent by the gateway usually includes three types: management log, operation log and access log. The management log records the management operations of the gateway by the administrator of the gateway, the operation log records the events that occur during the operation of the gateway itself, and the access log records the access events through the gateway. Usually, one session will generate an access log. Usually, there are not many management logs and operation logs of the gateway, but the access logs may reach tens of thousands per second. [00...

AI Technical Summary

Problems solved by technology

[0005] However, the performance of the log system based on the relational database is poor

On the one hand, in the log system implemented based on relational database, the insertion performance of log data is poor

If the relational database is indexed in order to improve the query performance of the log, the insertion performance of the log data will be further reduced

In addition, the insertion performance of a relational database will decrease as the number of records increases

On the other hand, even if the database is indexed, as the recorded logs increase, the query performance still cannot meet the requirements

[0006] In addition, the storage space (for example, disk space) utilization rate of the log system based on the relational database is low

In the log system based on the relational database, in order to improve the query performance of the log, it is necessary to establish a search index for the relational database. At this time, the storage space occupied by the relational database files will be significantly increased, so that the storage space utilization rate of the log system is low.

Images