Method and device for network flow data analysis based on stream processing

Abstract

The present invention provides a method and a device for network flow data analysis based on stream processing. The method comprises the steps of: obtaining original network flow data switched by a signaling transfer device; performing protocol matching of an original message in the original network flow data; marking a classification identifier distributed by the message for the original messageafter protocol matching; and sending the original message after protocol rule matching to a target processing node according to the classifier identifier, wherein the target processing node employs adistributed calculation stream data processing mode to perform business rule matching of the original message to generate XDR (External Data Representation) data in real time. According to the technical scheme disclosed by the embodiment of the invention, the method and the device for network flow data analysis based on stream processing meet the demand of real-time analysis of large-scale flow data in an operator communication device network so as to greatly improve the analysis efficiency and speed.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a method and device for analyzing network traffic data based on stream processing. Background technique [0002] With the continuous development of network technology, the types of applications and services provided by the network have been greatly enriched. At the same time, diversified services and increasing number of users have also made the operator's network more complex, which undoubtedly increases the difficulty of operation and maintenance of communication equipment, and also brings new opportunities and challenges to network service providers. . [0003] The analysis of large-scale data sent by communication equipment can help operators accurately control the information of network applications, and complete efficient network operation and maintenance management based on the controlled information, thereby supporting various business needs such as inform...

AI Technical Summary

Problems solved by technology

However, the existing DPI equipment has poor flexibility and poor software scalability, resulting in the loss of a lot of information in the output XDR data

The traditional steps of decoding, single-interface synthesis, backfill, and multi-interface synthesis are cumbersome when new business logic needs to be added, so a more flexible solution needs to be designed to generate personalized XDR information

Images