Multi-task scheduling method and system

A scheduling method and multi-task technology, applied in the field of data processing, can solve problems that affect the production and operation safety of the distributed batch scheduling framework, and the performance of the Zookeeper registration center decreases and increases, achieving visualization, reducing pressure, and good adaptability Effect

Pending Publication Date: 2021-06-15
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to support the business scenarios of the business system in this type of distributed batch scheduling framework, a large number of batch task instances are usually dynamically generated in the Zookeeper registry center, and the pressure of this type of distributed batch scheduling framework to monitor the data changes of the batch task instances in the Zookeeper registry center will suddenly increase , when the amount of batch task instance data exceeds a certain level, the performance of the Zookeeper registration center will degrade or even crash, which will affect the production and operation safety of the distributed batch scheduling framework

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-task scheduling method and system
  • Multi-task scheduling method and system
  • Multi-task scheduling method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of the application will be clearly and completely described below in conjunction with the drawings in the embodiments of the application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0048] In order to solve the batch scheduling dependency problem in the prior art and reduce the pressure on the Zookeeper registration center, this application considers to provide a multi-task scheduling method and system based on the existing fragmented task management mechanism of the existing distributed batch scheduling framework. It can support the dyna...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-task scheduling method and system, which can be used in the financial field or other fields, and the method comprises the following steps: receiving a job request sent by a target Zookeeper registration center; according to a preset multi-task scheduling general table, determining batch quantum tasks of a target task corresponding to the job request; and executing the batch quantum task. According to the invention, the pressure of the Zookeeper registration center can be reduced on the basis of realizing batch task scheduling.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a multi-task scheduling method and system. Background technique [0002] At present, the distributed batch scheduling frameworks commonly used in the industry, such as xxl-job and Elastic-job frameworks, can realize batch collaborative scheduling of multiple shards in distributed scenarios, but their batch task instances all rely on the distributed batch scheduling framework. Pre-defined schedule plan generation. [0003] In order to support the business scenarios of the business system in this type of distributed batch scheduling framework, a large number of batch task instances are usually dynamically generated in the Zookeeper registry center, and the pressure of this type of distributed batch scheduling framework to monitor the data changes of the batch task instances in the Zookeeper registry center will suddenly increase , when the amount of batch tas...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F9/5088
Inventor 陈郑渊明陈顺友赵新涛杨晓
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap