Dynamic load balancing method based on Linux parallel computing platform

Abstract

The invention provides a dynamic load balancing method based on a Linux parallel computing platform, and belongs to the field of parallel computing. The hardware architecture of the dynamic load balancing method comprises multiple computers participating in computing, and each computer is provided with a Linux operating system and an MPI software development kit. In the parallel computing process, general computing tasks are divided into multiple stages with the same execution time to be executed. The routine job scheduling technology in a system is utilized, the current resource utilization rate of each node is firstly read before parallel computing of each time phase begins, calculated performance and computational complexity of each node are combined, dynamic allocation is conducted on the computing tasks of the nodes, the fact that computing time of the nodes in every phase is basically equal is guaranteed, and system synchronization waiting delay is reduced. Through the dynamic adjustment strategy, the general computing tasks can be completed by means of higher resource utilization rates, the dynamic load balancing method breaks through efficiency bottlenecks caused by low configuration computational nodes, the computing time is further saved on the basis of the parallel computing, and computational efficiency is improved.

Description

Technical field [0001] The invention relates to a dynamic load balancing method based on a Linux parallel computing platform, belonging to the field of parallel computing. Background technique [0002] Parallel computing refers to the process of using multiple computing resources to solve computing problems at the same time. The main purpose of parallel computing is to quickly solve large and complex computing problems. In order to save costs and make full use of existing resources, multiple personal computers with common configurations can be used as computing nodes, and multiple nodes can be interconnected through the network, SSH remote login and MPI parallel library functions to build a parallel computing platform. At this stage, when using this type of parallel computing platform for parallel computing, a widely used parallel strategy is to evenly distribute the calculated parameters to each computer participating in the calculation, and use the communication interface func...

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the defects and insufficiencies of the prior art, and to solve the problems of low system resource utilization, unbalanced task distribution, and low computing efficiency when ordinary parallel computing executes large-scale and ultra-large-scale computing tasks, the present invention proposes a A Dynamic Load Balancing Method Based on Linux Parallel Computing Platform

Images