Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A distributed system task execution method and device

A distributed system and task execution technology, applied in the computer field, can solve problems that affect historical data acquisition, system performance, and system resource consumption, and achieve the effects of simplifying responsibilities, solving system bottlenecks, and reducing burdens

Active Publication Date: 2021-09-03
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF14 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] 1. JobServer is the node with the heaviest load in the entire system, and the performance of a single machine will seriously affect the performance of the entire system;
[0010] 2. The communication between Client, JobServer, and Worker will consume a lot of system resources. When the Client needs to obtain the result data multiple times, it will bring a huge system burden;
[0011] 3. The reliability of the system is low. If a Worker fails, it will affect the acquisition of historical data running on the Worker

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed system task execution method and device
  • A distributed system task execution method and device
  • A distributed system task execution method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0043] As the Gearman task distribution system described in the prior art, its main shortcoming is manifested in the following three aspects:

[0044] 1. The JobServer is located between the Client and the Worker, and is responsible for the distribution of tasks and the return of task execution results. It is the node with the heaviest load in the entire system, and the pe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed system task execution method and device, which can separate control task flow and result data flow, solve the system bottleneck problem of the task scheduler, reduce system resource consumption, and improve system reliability. The method for executing a task in a distributed system of the present invention includes: a task initiator creates a task and sends the task to a task scheduler; the task scheduler receives the task and distributes the task to a task processor; the task processor receives and executes the task, and Save the execution result of the task; the task initiator obtains the execution result of the task from the saved execution result.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method and device for executing distributed system tasks. Background technique [0002] A distributed task processing system is a computer system that combines multiple autonomous and interconnected computers to complete the same task under the coordination of a high-level operating system in order to improve the parallel processing speed of tasks. [0003] The existing distributed task processing system takes Gearman as an example, such as figure 1 Shown is the block diagram of the implementation of the existing Gearman task distribution system. The processing of a Gearman task involves three roles: Client, JobServer and Worker. in: [0004] Client, the initiator of the task, creates the task that needs to be executed and then sends it to the task scheduler JobServer; [0005] JobServer, the task scheduler, is responsible for coordinating and forwarding the task ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4812G06F9/505
Inventor 高平孔文杰冷维伟邢磊
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products