Resource scheduling method and system based on multi-dimensional constraint genetic algorithm

A technology of resource scheduling and fitness, applied in the field of data processing, can solve problems such as the reduction of users' reasonable allocation of resources, the unsatisfactory scheduler, and the low efficiency of resource allocation.

Pending Publication Date: 2019-08-09
CHENGDU UNIV OF INFORMATION TECH
View PDF12 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (1) In the existing technology, the efficiency of resource allocation is low, and the overall completion time of cluster tasks is long
[0006] (2) In different application scenarios, the scheduler in the prior art cannot well meet the needs of users to allocate resources reasonably and reduce task execution time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method and system based on multi-dimensional constraint genetic algorithm
  • Resource scheduling method and system based on multi-dimensional constraint genetic algorithm
  • Resource scheduling method and system based on multi-dimensional constraint genetic algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0110] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0111] In the prior art, the efficiency of resource allocation is low, and the overall completion time of cluster tasks is long. In different application scenarios, the scheduler in the prior art cannot well meet the user's requirement of rationally allocating resources and reducing task execution time.

[0112] In order to solve the above problems, the present invention will be described in detail below in conjunction with specific solutions.

[0113] Such as figure 1 As shown, the Hadoop resource scheduling method designed based on the multi-dimensional constrained genetic algorithm provided by the embodiment of the pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of data processing, and discloses a resource scheduling method and system based on a multi-dimensional constraint genetic algorithm, and the method comprises the steps: carrying out the initialization of a prediction model, a task matrix, and a node matrix, and building a dual-fitness function; formulating an option-Copying operator, a cross operator and a variation operator; and after multiple iterations, obtaining a globally optimal resource allocation mode. In order to seek a better resource allocation scheme, the invention provides a Hadoop resource scheduling algorithm based on a multi-dimensional constraint genetic algorithm, and a Hadoop resource scheduler is realized through the algorithm; by the adoption of the algorithm, the cluster resource distribution efficiency can be effectively improved, and the overall completion time of cluster tasks is shortened by about 20%.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a resource scheduling method and system based on a multi-dimensional constrained genetic algorithm. Specifically, it is a Hadoop resource scheduling method and system based on multi-dimensional constraint genetic algorithm Background technique [0002] Currently, the closest prior art: [0003] The resource scheduling problem is a combinatorial optimization problem, and its ultimate goal is to assign all tasks of the cluster to the most suitable nodes for execution to achieve the optimal overall performance of the cluster. Hadoop YARN provides three built-in resource scheduling algorithms and implements corresponding resource schedulers, namely FIFO, Capacity and Fair schedulers. However, with the continuous expansion of application scenarios (such as iterative computing, interactive computing, and real-time computing), these schedulers cannot well meet the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06N3/12
CPCG06F9/5027G06N3/126
Inventor 张路桥滕彩峰李飞王娟韩斌
Owner CHENGDU UNIV OF INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap