Job scheduling system suitable for grid environment and based on reliable expense

Abstract

The invention relates to an operation scheduling system which is applicable to the grid environment and based on the reliability cost; as indicated in graph 1, the whole system includes three layers: the first layer is an operation submission interface module 1; the second layer is an operation scheduling module 2 and the grid resource platform 7 as the substrate layer. From the perspective of the operational principle, the core of the invention is the operation scheduling module in the second layer, which includes a pre-scheduling module 3, a scheduling strategy module 4, an operation finish time prediction module 5 and a resource information module 6. The operation scheduling system in the invention proposes an operation running time prediction model and a resource usability prediction model; the operation running time prediction model based on the mathematical model and the resource usability prediction model based on the Markov model have high accuracy and high generality. The operation scheduling system adopts the copy fault-tolerance strategy, the primary copy asynchronous operation fault-tolerance strategy and the retry fault-tolerance respectively according to different operation service quality requirements and resource characteristics so that the operation scheduling system has high flexibility and high validity; meanwhile, the operation scheduling system supports the computation-intensive operation and the data-intensive operation to have good generality. Compared with the scheduling system in the prior art, the operation scheduling system has the advantages of supporting more concurrent users, improving the resource utilization rate, good generality, good extensibility and high system throughput.

Description

technical field [0001] The invention belongs to the field of grid computing, and in particular relates to a reliability cost-based job scheduling system suitable for grid environments. Background technique [0002] The grid integrates dynamic, autonomous and heterogeneous network resources distributed on the Internet (including high-speed Internet, computers, large databases, sensors, remote devices, etc.), and it shields the dynamics, heterogeneity and distribution of resources , to provide users with an efficient resource sharing and collaborative work environment. As soon as grid technology was proposed, it attracted great attention from academia and industry, and achieved rapid development. Compared with traditional distributed high-performance computing, the advantages of grid are as follows: (1) effective use of widely distributed resources; (2) efficient collaboration between heterogeneous organizations; (3) effective solution to computing-intensive and data-intensiv...

AI Technical Summary

Problems solved by technology

[0005] The traditional job scheduling system does not fully consider the dynamics of resources in the grid environment, resulting in frequent job failures

In addition, traditional scheduling systems mostly use a single fault-tolerant mechanism, which lacks flexibility and wastes system resources

Images