Method and system for organizing, storing and querying network traffic logs

A technology of network traffic and query method, which is applied in the field of computer software, can solve problems such as log storage and retrospective query, and achieve the effects of optimizing efficiency and storage speed, reducing efficiency, and reducing enterprise costs

Pending Publication Date: 2022-03-22
武汉思普崚技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome the above-mentioned technical deficiencies, and provide a method and system for organizing, storing, and querying network traffic logs. By reasonably storing the logs generated by Internet access devices, the storage speed is guaranteed, and fast query, aggregation, and analysis can be achieved. The purpose of solving the technical problems of poor log storage and backtracking query in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for organizing, storing and querying network traffic logs
  • Method and system for organizing, storing and querying network traffic logs
  • Method and system for organizing, storing and querying network traffic logs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0032] Such as figure 1 As shown, the present invention provides a method for organizing, storing, and querying network traffic logs, including:

[0033] S101, each field of the network traffic log data is grouped by column with relevant column information, the network traffic log data is appended at the end of the column in turn, saved as different files, and the summary information of the network traffic log data in the file is recorded; wherein the relevant columns Information includes, but is not limited to, network session time, network session subjects, and network session objects.

[0034]...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a network flow log organization, storage and query method and system, and belongs to the technical field of computer software. The method comprises the steps that all fields of network flow log data are divided and grouped according to related column information and columns, the fields are stored as different files, and summary information of the network flow log data in the files is recorded; storing the data divided and grouped according to columns in the file in combination with a log structure merging tree, and compressing each column of data; and querying the data divided and grouped according to the columns in the file, dividing and conquering the column information to obtain query keywords, and querying the data of each column. According to the method and the device, the logs generated by the internet equipment are reasonably stored, the storage speed is ensured, the purposes of quick query, aggregation and analysis can be achieved, and the technical problem of poor log storage and backtracking query effects in the prior art is solved.

Description

technical field [0001] The invention relates to the technical field of computer software, in particular to a method and system for organizing, storing and querying network traffic logs. Background technique [0002] According to the "Network Security Law of the People's Republic of China": Take technical measures to monitor and record network operation status and network security incidents, and keep relevant network logs for no less than six months in accordance with regulations. [0003] Therefore, in an enterprise, keeping various logs generated by users surfing the Internet is firstly in line with national policies; secondly, it can use backtracking logs to obtain optimization solutions for various problems in the network and reduce operation and maintenance costs. For large enterprises, various Internet logs generated within the enterprise are massive. How to solve log storage and backtracking query is imminent. [0004] In the current solution, technologies such as My...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/18G06F16/172G06F16/174G06F16/14G06F16/13
CPCG06F16/1815G06F16/172G06F16/1744G06F16/148G06F16/13
Inventor 王涛
Owner 武汉思普崚技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products