Distributed task system, management method, device and computer equipment

Abstract

The invention provides a distributed task system, a management method, a device and computer equipment. The distributed task system comprises a main node, a working node and a management node, the management node is used for storing the task state of a timing task, and the working node is used for executing the timing task and modifying the task state according to the execution state of the timingtask; wherein an execution main body of the distributed task management method is a main node, and the distributed task management method comprises the steps that whether a first task exists in a task message queue or not is inquired, the task message queue comprises a to-be-executed timing task, and the first task is a timing task meeting the execution time requirement; when the task message queue has the first task, distributing the first task to a first working node; obtaining a task state of the first task from a management node; and managing the first task according to the obtained taskstate of the first task. According to the invention, the stability of the timing task can be improved.

Description

technical field [0001] The invention relates to the technical field of distributed task processing, in particular to a distributed task system, management method, device and computer equipment. Background technique [0002] At present, in Internet scenarios of various business types, there are a large number of various scheduled tasks that need to be executed every day, including scheduled statistical tasks and scheduled data pull tasks. For example, the regular settlement system needs to settle the user consumption data and commodity sales statistics data of the previous day after midnight every day; the report system needs to aggregate data regularly, obtain the data aggregation results on specific dimensions regularly, and display the data dynamically over time trend. It will involve some data synchronization tasks, regularly pull data, and then transfer to the designated data storage tool. [0003] In the prior art, the regular task manager crontab is usually used to m...

AI Technical Summary

Problems solved by technology

Although the timing task manager crontab is simple and easy to use, the inventor found that it cannot guarantee the normal execution of the timing task, which makes the execution stability of the timing task poor. Tasks are not responsible for the execution status and execution results of tasks, and there is no way to manage scheduled tasks according to the execution status of tasks

[0004] Therefore, the technical problem of poor stability in timing task execution in the prior art has become a technical problem that needs to be solved urgently in this field

Images