Wavelet Tree based network data packet indexing system

A network data packet and indexing system technology, applied in the field of computer network security, can solve the problems of increasing the index size and so on

Inactive Publication Date: 2016-06-29
HUNAN UNIV
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the bitmap index technology is applied to the network data packet query environment, when the number of data packets rises to millions, the size of the index established by this technology will increase abnormally

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wavelet Tree based network data packet indexing system
  • Wavelet Tree based network data packet indexing system
  • Wavelet Tree based network data packet indexing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] 1. Program framework

[0061] Input: the operation to be performed (getValue()) and the filename to perform the operation on (input_file).

[0062]

[0063] 2. Experimental environment

[0064] The hardware environment of the present invention is mainly a DDR3 server. Among them, the CPU of the server is XEONL5520, and the memory is 256GB. Experimental data is stored on a 1TB hard disk drive (HDD) and a 256GB SSD (PX-256M6S).

[0065] The software implementation of the present invention takes ubuntu14.04 as a platform, and uses C++ language development.

[0066] The experimental data comes from the real-time communication data of the export route of a certain university, and its format is pcap file.

[0067] In the experiment, it is evaluated from three aspects: 1) disk space required for indexing, 2) time required for indexing, and 3) packet query performance.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to network data analysis in the field of computer network security, and in particular, to a method for performing indexing, querying and analysis on massive network data packets. The method provided by the present invention is capable of rapidly and accurately searching out a data packet that satisfy a condition from the massive network data packets, and the method is based on a novel data structure Wavelet Tree, and indexing and querying functions are implemented by means of the data structure, wherein a process of the querying function is as shown in FIG.1. The system provided by the present invention needs relatively little space for storing an established index file, and supports various complex queries, such as an accurate query, a range query and an extreme value query for a certain attribute, and the like.

Description

technical field [0001] The invention relates to network data analysis in the field of computer network security, in particular to a method for indexing and querying and analyzing massive network data packets. Background technique [0002] In the research of network monitoring and network security, the analysis of captured network data packets is an important topic. By capturing and analyzing them, effective monitoring of the network can be realized, and faults in the network can be accurately located. For current network data analysis tasks, such as protocol performance evaluation, network monitoring and dialectical analysis, when analyzing errors and evaluating performance, the network data packet query process needs to be completed quickly and efficiently. In fact, this process is a CPU-intensive task, especially when processing a large file with complex communication methods, it will bring a lot of burden to the CPU. At the same time, with the rapid development of the n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/951
Inventor 孙建华姚姝娜
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products