Stream processor parallel environment-oriented data stream communication system and method

Abstract

The invention discloses a stream processor parallel environment-oriented data stream communication system and method, which relate to the technical field of parallel communication and are used for solving the technical problem that the inconvenience in developing a CUDA (Compute Unified Device Architecture) and MPI (Message Passing Interface) hybrid program is unbeneficial to real-time processingof mass data streams. Each computation node in the system is provided with a CPU (Central Processing Unit) computation component, GPU (Graphics Processing Unit) computation component, a dynamic pipeline pool as well as an MPI receiving component and an MPI transmitting component for MPI communication; a node resource table, a component resource table and a current communication pipeline mapping table are arranged in each computation node; communication among computation node components is performed by using the dynamic pipeline pool; and the communication data unit is used for transmitting. The communication system and the communication method thereof provided by the invention can effectively support the construction of a large-scale information processing parallel environment by using the MPI and a stream processor computer, contribute to system program development of programmers, and are suitable for constructing cloud computation nodes and processing a large scale of data streams in real time.

Description

technical field [0001] The invention relates to data communication technology, in particular to a data stream communication system and a communication method thereof for a stream processor parallel environment. Background technique [0002] With the rapid development of information technology and the popularization of Internet technology applications, the network has become an important part of people's daily life. In recent years, the gradual application of 3G network and Internet of Things technology has brought great convenience to people's life and work. However, the wide application of these new technologies brings new challenges of massive information processing and how to improve large-scale real-time support capabilities. New computing devices represented by stream processors have brought hope to solve these difficulties. Stream processor is the general term for GPU to go to the field of general computing. It is named for its internal use of hundreds of Stream proc...

AI Technical Summary

Problems solved by technology

[0003] However, the processing environment of each computing node and the communication environment between computing nodes in the existing stream processor-based network are relatively complicated, which makes CUDA (Compute Unified Device Architecture) programmers and CTM (Close To Metal) programmers develop Parallel communication programs and parallel stream processor programs require a detailed understanding of the processing details of computing nodes and the communication details between computing nodes, which is not conducive to the development of system programs, and is also not conducive to massive data streams (such as 3G video streams) real-time processing

Images