Task batch processing method and device, computer equipment and storage medium

A batch processing and task technology, applied in the field of data processing, can solve the problems of high error rate, untimely, low efficiency, etc., to achieve the effect of simple generation, improved processing efficiency and accuracy

Pending Publication Date: 2022-04-26
PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of this application is to provide a batch task processing method, device, computer equipment and storage medium to solve the problems of low efficiency, high error rate and untimely processing of batch tasks in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task batch processing method and device, computer equipment and storage medium
  • Task batch processing method and device, computer equipment and storage medium
  • Task batch processing method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] In order to solve the problems of low efficiency, high error rate and untimely processing of batch tasks in the prior art, this application provides a task batch processing method based on the Azkaban platform. When there are hundreds of tasks to be executed, or Thousands of manual click tasks take a long time. We write related tool packages by calling the azkaban underlying API, and execute batch tasks by reading txt files. Use the python language to write code, call the requests module to connect to the online azkaban, obtain the corresponding sessionId, and use the sessionid to operate the current login azkaban user. By analyzing each url of azkaban, we can get the operation instructions of related workflow tasks, initiate requests and execute related requests through the request module.

[0074] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of data processing and artificial intelligence, and discloses a task batch processing method and device, computer equipment and a storage medium. Simple information in the to-be-processed task is added into the task execution file, then the Azkaban platform is called to analyze the task execution file, and the to-be-processed task recorded in the task execution file is extracted, so that automatic control execution of the task is determined, most manual processing can be omitted in the period, the error rate and the error and omission rate are reduced, most manpower is saved, and the task processing efficiency is improved. According to the method, task processing can be rapidly achieved in batches only by writing the corresponding configuration file and calling the corresponding method, compared with the prior art, the TXT file is easy to generate in the processing mode, all the tasks can be processed in time, and the task processing efficiency and accuracy are greatly improved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a task batch processing method, device, computer equipment and storage medium. Background technique [0002] In the configuration and execution of daily tasks, with the increase of tasks, there are more and more engineering projects-workflow flow-jobs. Especially when scheduled tasks are offline, task monitoring and inspection, deletion scheduling, and configuration scheduling are all concentrated at a specific time, the processing capacity is relatively large, and manual assistance often occurs. Manual intervention increases the error rate of task operations. When it is impossible to intervene, the processing of the task is delayed, which increases the time-consuming task processing and consumes a lot of manpower. Contents of the invention [0003] The main purpose of this application is to provide a task batch processing method, device, computer equipment and storage medium to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/30G06F8/41
CPCG06F8/31G06F8/427
Inventor 熊礼锋
Owner PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap