Network traffic simulation system for network transmission process based on spark computing framework

Abstract

The invention discloses a network simulation system based on a Spark computing framework network transmission process. The network simulation system comprises a load generation module (1), a network topology configuration module (2), a visualization module (3), a scheduling module (4) and a data tracking module (5). And the scheduling module (4) and the data tracking module (5) are respectively arranged on the working simulation node and the driving simulation node. The network transmission process of the Spark computing framework is simulated on the basis of the Spark computing framework in combination with a container virtualization technology and a message driving mechanism. A Spark computing cluster simulation node is established by adopting a container virtualization technology, and areal network data packet is transmitted in a simulation process, so that the effect of an experimental scheme in a real environment can be better reflected.

Description

Technical field [0001] The present invention relates to a network flow simulation of the SPARK computing frame, and more particularly to network traffic simulation of a network transmission process facing the SPARK computing frame. Background technique [0002] Network Simulation Technology is a simulation technology of network performance data required for network design or optimization by establishing a statistical model of network devices and network links, analog network transmission traffic. It has a new analog experiment mechanism and the ability to get high credibility results in a highly complex network environment. Through network simulation, quantitative analysis data can be provided to optimize and expand existing networks. [0003] Apache Spark is a quick and universal computing engine designed for large-scale data processing. Spark is a generic parallel framework for class Hadoop MapReduce, an UCberkeley AMP Lab, and Spark has the advantages of Hadoop MapReduce. The ...

AI Technical Summary

Problems solved by technology

[0005] In the field of network simulation technology for the network transmission process of the Spark computing framework, the existing simulation technology is often simply replayed according to the input load (load), without considering the data transfer flow (data transfer) in the network traffic (network traffic) flow) and control message flow (control message flow), so the simulation effect cannot reflect the application layer (application layer) characteristics of the data transmission process of the Spark computing framework

Images