Task scheduling method, device and equipment and storage medium

Abstract

The embodiment of the invention discloses a task scheduling method and device, equipment and a storage medium. The method is executed by a management node of a task scheduling system, the task scheduling system comprises at least two management nodes, and the method comprises the steps that a target management node reads task parameters of a target task scheduling request in an application servicenode; the task parameters in the target task scheduling request are spliced into an executable command statement according to a preset executable command generator; heartbeat information sent by at least one candidate task submitter is received, and a target task submitter is determined according to the heartbeat information; and the executable command statement is sent to a target task submitter, so that the target task submitter sends the executable command statement to the cluster, the cluster executes the task scheduling request, and the target task submitter determines an execution stateof the target task in the cluster. Reasonable allocation of numerous tasks is realized, and high availability and task scheduling efficiency of the system are ensured.

Description

technical field [0001] The embodiments of the present invention relate to computer technology, and in particular to a task scheduling method, device, equipment and storage medium. Background technique [0002] The user portrait system is the basic system for applications such as intelligent marketing, user insights, and personalized recommendations. It needs to connect with different staff so that the staff can configure user groups according to their own needs. When configuring and using user group data, the task scheduling system is required to allocate many tasks reasonably. [0003] In the prior art, the task scheduling system only includes a management node, which is responsible for managing and receiving all task scheduling requests from application service nodes. When the management node fails, the target task cannot be completed, and the target task is sent to the task submitter at the management node When , there is a situation that the task submitter cannot handle...

AI Technical Summary

Problems solved by technology

[0003] In the prior art, the task scheduling system only includes a management node, which is responsible for managing and receiving all task scheduling requests from application service nodes. When the management node fails, the target task cannot be completed, and the target task is sent to the task submitter at the management node When , there is a situation that the task submitter cannot handle the target task, and the reliability and efficiency of task scheduling are low

Images