Large-scale resource scheduling system and large-scale resource scheduling method based on deep learning neural network

Abstract

The invention claims a large-scale resource scheduling system and a large-scale resource scheduling method based on a deep learning neural network. The system comprises at least one scheduling controlmodule and at least two execution modules; the scheduling control module is used for receiving a use request, allocating a scheduling resource and performing parallel computing of state feedback; theexecution modules are used for receiving a task request sent by the scheduling control module, opening up a memory space and performing computation. In the system and the method provided by the invention, a user task request interface is provided, and a scheduler receives a submitted task request information, predicts and judges whether a task satisfies expectation of task completion conditions of a user through the deep learning neural network and consequently determines an initialization parameter of a resource scheduling policy. The scheduler segments the task according to the resource scheduling policy and allocates the task to the execution modules to complete computation. While performing computation and tidying for the task, the execution modules feeds back resource information tothe scheduling control module to complete the user task uniformly.

Description

Technical field [0001] The invention belongs to the technical field of resource scheduling, and relates to a large-scale resource scheduling system and method based on a deep learning neural network. Background technique [0002] With the development of Internet technology, resource scheduling technology has matured day by day. The existing resource scheduling program generally starts from resource scheduling rules based on dynamic monitoring of resource load of resource pools to realize the redistribution of virtual machines among physical servers in the resource pool. When the resources to be allocated are too large, far beyond the scope of the resource scheduling rules, it may lead to unreasonable resource scheduling or even resource scheduling failure. [0003] Currently, there are roughly the following methods for large-scale resource scheduling in use: [0004] One is to use a clustered method for distributed training of deep neural networks and then to perform distributed res...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above technical problems, the present invention proposes a large-scale resource scheduling system and method based on a deep neural network, which uses the parallel characteristics of a deep neural network to process data sets in a distributed form for the training model, and dynamically executes resource scheduling, effectively Solve the problem that the existing large-scale resource scheduling method lacks the distributed parallel execution function

Images