Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Scheduling task parallel execution method, system and device and storage medium

A task and memory technology, applied in the field of data processing, can solve the problems of complex design, complex task scheduling and data operation, and achieve the effects of simple development and design, easy expansion and maintenance, and simple operation.

Pending Publication Date: 2020-02-04
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The technical problem to be solved by the present invention is to provide a method, system, device and storage medium for parallel execution of scheduling tasks in order to overcome the defects of complex data operations and complex design of scheduling tasks during data processing in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scheduling task parallel execution method, system and device and storage medium
  • Scheduling task parallel execution method, system and device and storage medium
  • Scheduling task parallel execution method, system and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] This embodiment provides a method for scheduling tasks to execute in parallel, such as figure 1 As shown, the methods for scheduling tasks to execute in parallel include:

[0042] Step 101, define a scheduling task, the scheduling task includes a task period and processing logic for processing data of the task period.

[0043] The task period can be different periods such as minutes, hours, days, weeks, months, or years. In practical applications, the task period can be any set time period. In this embodiment, taking the task cycle as an example of a day, the scheduling task is used to process data in units of days, for example, the data of the previous day will be processed regularly every day.

[0044] In this embodiment, the dispatching system is used to define dispatching tasks. The dispatching system is the core hub of data processing, and performs unified work allocation and management for all tasks of data processing, ensuring orderly, safe and reliable operatio...

Embodiment 2

[0060] This embodiment provides a system for scheduling tasks to execute in parallel, such as figure 2 As shown, the system for scheduling parallel execution of tasks includes a definition module 201 , a judgment module 202 , a copy module 203 , a scheduling module 204 and a monitoring module 205 .

[0061] The definition module 201 is used to define a scheduling task, and the scheduling task includes a task period and processing logic for processing data of the task period.

[0062] The task period can be different periods such as minutes, hours, days, weeks, months, or years. In practical applications, the task period can be any set time period. In this embodiment, taking the task cycle as an example of a day, the scheduling task is used to process data in units of days, for example, the data of the previous day will be processed regularly every day.

[0063] In this embodiment, the dispatching system is used to define dispatching tasks. The dispatching system is the core ...

Embodiment 3

[0077] image 3 It is a schematic structural diagram of an electronic device provided by Embodiment 3 of the present invention. The electronic device includes a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the method for parallel execution of scheduled tasks in Embodiment 1 when executing the program. image 3 The electronic device 30 shown is only an example, and should not limit the functions and scope of use of the embodiments of the present invention.

[0078] Such as image 3 As shown, electronic device 30 may take the form of a general-purpose computing device, which may be a server device, for example. Components of the electronic device 30 may include, but are not limited to: at least one processor 31 , at least one memory 32 , and a bus 33 connecting different system components (including the memory 32 and the processor 31 ).

[0079] The bus 33 includes a data bus, an address bus, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a scheduling task parallel execution method, system and device and a storage medium, and the method comprises the steps: defining a scheduling task which comprises a task period and a processing logic for processing the data of the task period; respectively copying the scheduling tasks to obtain at least two mirror image tasks, and correspondingly setting different task periods for different mirror image tasks; and scheduling all the mirror image tasks to run in parallel to process the data of the corresponding task period. According to the scheduling task parallel execution method, at least two mirror image tasks are obtained by copying the scheduling tasks respectively, and different task periods are correspondingly set for different mirror image tasks; all mirrorimage tasks are scheduled to run in parallel to process data of corresponding task periods, so that processing data of multiple periods can be simultaneously processed in parallel, the operation is simple, and meanwhile, the system is simple in development and design and easy to expand and maintain.

Description

technical field [0001] The present invention relates to the field of data processing, in particular to a method, system, device and storage medium for scheduling tasks to be executed in parallel. Background technique [0002] In business scenarios such as data processing, scheduling tasks are defined through the scheduling system to process different business logics and realize data processing. Each scheduling task has a fixed processing cycle to process data of a specific period. For example, a daily task will process the data of the previous day regularly every day, and a weekly task will process the data of the previous week regularly every week. [0003] In most scenarios, the same scheduling task will only process the data of a specific period in the same period, for example, the scheduling task running on the current day processes the data of the previous day. [0004] Each scheduling task has its execution status when it is executed. For example, when the scheduling ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4843G06F9/4881G06F9/5027
Inventor 刘永和刘荣明
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products