A Double Sampling Based Network Data Carrier Judgment Method in Dedicated Line Environment

A network data, double sampling technology, applied in transmission systems, electrical components, etc., can solve problems such as waste, business data redundancy, and increased complexity

Active Publication Date: 2022-04-19
CHENGDU JIUZHOU ELECTRONIC INFORMATION SYSTEM CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This situation is a waste of collection and processing resources. At the same time, the same data will cause data redundancy and increase complexity in the business in the data fusion and correlation analysis scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Double Sampling Based Network Data Carrier Judgment Method in Dedicated Line Environment
  • A Double Sampling Based Network Data Carrier Judgment Method in Dedicated Line Environment
  • A Double Sampling Based Network Data Carrier Judgment Method in Dedicated Line Environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present invention collects real-time network data, analyzes the link layer and network layer information of the network data, extracts the TTL value, screens out data with a TTL value of 255, performs the first round of sampling processing, and filters out the first hop data sent by the router , to filter out the huge data generated by other devices, greatly reducing the amount of data for subsequent analysis; this invention puts the data with a TTL value of 255 into a PCAP file in a specified format, providing effective sample data for subsequent offline analysis, and converting real-time data The problem that cannot be effectively verified is converted into an offline provable problem; the present invention extracts the six-tuple and calculates the hashkey to represent the session flow by preprocessing the offline PCAP, and writes the multi-dimensional information into the session attribute table with the session flow as the unit. A large amount of original data is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a network data carrier weight judging method in a dedicated line environment based on double sampling, comprising five steps of real-time data sampling processing, off-line preprocessing, task group arrangement, sampling summary processing, and weight judgment analysis processing. The double-sampling-based method for judging the weight of network data carriers in a private line environment of the present invention is used to solve the problem of data duplication caused by the existence of superior-subordinate or inclusion relationships in network data carriers in the process of distributed network traffic processing. Using the double sampling mechanism, combined with multi-threading technology, event notification mechanism, related data grouping, task arrangement, abstract data serialization and deserialization, Hash search and other algorithms, to realize the judgment of network data carrier repeatability, and calculate its repeat relationship at the same time confidence level.

Description

technical field [0001] The invention belongs to the field of network data processing, in particular to a method for judging the weight of network data carriers in a dedicated line environment based on double sampling. Background technique [0002] In the field of distributed and multi-node network traffic collection and processing business, there is usually a superior-subordinate or containment relationship between the nodes deployed. For example, if the city-level and provincial-level traffic are collected and processed at the same time, the same data may appear in the system. twice or even multiple times. The reason for this is that there are relays or extensions of the bearer carrying the network data. This situation is a waste of collection and processing resources. At the same time, the same data will cause data redundancy and increase the complexity of the business in the data fusion and correlation analysis scenarios. [0003] Therefore, it is necessary to propose a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L69/22
CPCH04L69/22
Inventor 原小卫李丽娟霍曦汪俊贵段军邹昆郭春江李亮李晨华洋古训刘越
Owner CHENGDU JIUZHOU ELECTRONIC INFORMATION SYSTEM CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products