Distributed network measured data statistical analysis method

Abstract

The invention relates to a distributed network measured data statistical analysis method. In the method, a two-stage distributed processing way consisting of probe equipment pre-processing and data analysis server post-processing is adopted. The method comprises the following steps that: probe equipment performs matching, pre-processing and fusing operations on acquired original data according to a data analysis rule issued by a data analysis server; and after the operations are finished, a front-end processing result and a part of fused data are transmitted to the data analysis server in the form of a report message through service Ethernet, and the data analysis server receives the fused data, performs post-processing on data pre-processing results summarized by probes and the fused data, and finally submits post-processed results and data to a user. Through adoption of the distributed network measured data statistical analysis method, the processing capability of the probe equipment can be brought into full play on the premise of keeping existing equipment and an existing configuration method, and the aims of lowering transmission overload of the service Ethernet, lowering computing overhead of the data analysis server and improving the overall performance of an analysis system are fulfilled.

Description

technical field [0001] The invention belongs to the field of network communication, and in particular relates to a distributed statistical analysis method for network measurement data. Background technique [0002] Data collection and analysis of high-speed network is one of the important means and methods to analyze data transmission performance, diagnose network faults, and judge packet transmission service quality. Passive measurement and analysis of network data has been widely used as a network measurement method with the advantages of low overhead, accurate acquisition and measurement, and no impact on existing network user services. Generally speaking, the network passive measurement method is implemented by deploying probe devices and data analysis server devices in the network. The probe device is similar to the surveillance camera on the road. It is connected to the hot spot in the network that needs to be monitored and analyzed, and collects and processes the pas...

AI Technical Summary

Problems solved by technology

[0005] (2) The centralized processing capacity cannot meet the requirements

[0007] Chinese patent 201220245806.3 discloses a distributed data statistics system for balancing data processing tasks and improving data processing efficiency; the system uses the standard HTTP protocol, and does not define statistical analysis methods related to network measurement, which is not suitable for application to Distributed data analysis and processing in the field of network measurement with high requirements for data fusion processing

Images