Log compression storage method and electronic device

A compressed storage and log technology, which is applied in digital data processing, digital data information retrieval, special data processing applications, etc., can solve the problems of multiple storage spaces, large time costs, disk space waste, etc., to achieve simple operation and improve efficiency , the effect of improving the degree of convenience

Pending Publication Date: 2021-06-15
北京图拉扬科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still contradictions between compressed storage and log query. If the log is not compressed, if the log volume is relatively large, more storage space will be wasted, which is not conducive to saving the cost of the enterprise; but after the log is compressed, it is very inconvenient to view the log. Generally, you need to decompress before you can browse normally, which is time-consuming and inconvenient
[0003] 1. If the log content is large, it takes a long time to compress and decompress; if there are too many decompressed files, it will also cause a serious waste of disk space; if the log queryer is not particularly sure about the date of the log, or needs to The logs may occur at the time of alternating dates, and it is often necessary to decompress multiple files to see the required logs, which has a large time cost for locating and analyzing problems
[0004] 2. Technologies such as elk have a certain learning cost; in addition, the elasticsearch used for storage does not solve the problem of occupying too much storage space; if self-built, there is a certain maintenance cost, and if cloud services are used, corresponding fees need to be paid storage cost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log compression storage method and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Design concept of the present invention is:

[0026] The present invention changes the way of compressing the entire file in the prior art into compressing and storing by time segment, and indexes it to improve query efficiency. When the user browses the logs, he can retrieve and view the logs of the time period according to the time period. Since the amount of logs decompressed each time is very small, the effect of browsing while decompressing can be achieved, instead of waiting for all content to be decompressed before viewing. The method will be described in detail below.

[0027] The log compression storage method of the present invention comprises the following steps:

[0028] Step 1. Predefine the log storage structure; the defined log storage structure is divided into a parameter area, an index area, and a log area.

[0029] The index area contains N indexes; N is an integer, and N is equal to the ratio of the total duration of a day to the defined minimum lo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a log compression storage method and an electronic device. The method comprises the following steps: step 1, pre-defining a log storage structure, wherein the defined log storage structure is divided into a parameter area, an index area and a log area, the index area comprises N indexes, n is an integer, and N is equal to the ratio of the total duration of one day to the defined minimum log cutting time unit; step 2, determining log compression custom parameters, and storing the parameters in a parameter area; and step 3, compressing the original log needing to be compressed according to the log compression self-defined parameters. According to the method, the logs are synchronously compressed, decompressed and displayed according to the time periods, the convenience degree of checking the logs by users is improved, and the problem positioning efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data compression processing, in particular to a log compression storage method and an electronic device. Background technique [0002] Various websites and software will generate various logs. In order to facilitate finding and locating problems, it is often necessary to back up and archive these logs. When archiving, in order to reduce the storage space occupied by logs, historical logs are often compressed and stored. However, there are still contradictions between compressed storage and log query. If the log is not compressed, if the log volume is relatively large, more storage space will be wasted, which is not conducive to saving the cost of the enterprise; but after the log is compressed, it is very inconvenient to view the log. Generally, you need to decompress it before you can browse normally, which is time-consuming and inconvenient. [0003] 1. If the log content is large, it takes a long tim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/174G06F16/18
CPCG06F16/1744G06F16/1815G06F16/134
Inventor 邓小龙元金良罗海斌
Owner 北京图拉扬科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products