Big data task dynamic arrangement scheduling method and device and computing equipment

A scheduling method and big data technology, applied in the field of big data, can solve the problem that key scheduling cannot be executed on time, and achieve the effect of optimal execution

Pending Publication Date: 2021-02-12
深圳市房多多网络科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Data warehouse scheduling is generally executed in accordance with the pre-configured scheduling sequence, the process is fixed, and the sequence is fixed, resulting in key scheduling not being executed on time in some special scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data task dynamic arrangement scheduling method and device and computing equipment
  • Big data task dynamic arrangement scheduling method and device and computing equipment
  • Big data task dynamic arrangement scheduling method and device and computing equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0026] figure 1 A schematic flowchart of a method for dynamically orchestrating and scheduling big data tasks provided by an embodiment of the present invention is shown. This method is executed by the server. Such as figure 1 As shown, the dynamic orchestration and scheduling methods of big data tasks include:

[0027] Step S11: Construct a directed acyclic graph based on the dependencies of multiple tasks, wherein the circles in the direct...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the technical field of big data, and discloses a big data task dynamic arrangement scheduling method and device and computing equipment. The method comprisesthe steps that a plurality of tasks form a directed acyclic graph according to the dependency relationship, circles in the directed acyclic graph represent the tasks, and circles in the directed acyclic graph represent the tasks, wherein the numbers in the circle represent the number of required resources for executing the task; dynamically weighting the resource demand quantity of the key tasksrequired by limited time in the directed acyclic graph at intervals of first preset time; and executing the task in the directed acyclic graph according to a preset rule. By means of the mode, dynamictask arrangement can be conducted, execution of the scheduling task is optimized and adjusted, and it is guaranteed that the key task can be completed on time.

Description

technical field [0001] Embodiments of the present invention relate to the field of big data technology, and in particular to a method, device, and computing device for dynamically orchestrating and scheduling big data tasks. Background technique [0002] Data warehouse (DataWarehouse, DW) is a subject-oriented (Subject Oriented), integrated (Integrate), relatively stable (Non-Volatile), reflecting historical changes (Time Variant) data collection, used to support management decisions. The data warehouse is organized according to themes, and the original scattered database data is extracted and cleaned up through systematic processing, summarization, and sorting. Inconsistencies in source data must be eliminated to ensure that the information in the data warehouse is consistent global information about the entire enterprise. Once the data enters the data warehouse, it will exist for a long time and be queried by users in large numbers, with few modification and deletion oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4843G06F9/4881G06F9/5027
Inventor 徐文振
Owner 深圳市房多多网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap