Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for task scheduling in a distributed system

A distributed system and task scheduling technology, which is applied in the distributed system task scheduling device and the field of distributed system task scheduling, can solve the problems of occupying computing resources, uneven distribution of computing resources, and low task operating efficiency, and achieve operating efficiency high effect

Active Publication Date: 2019-11-22
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional scheduling strategy is a stateless computing resource scheduling strategy. Generally, it is known that computing nodes have computing resources, and they are randomly provided to the computing framework, which often leads to uneven distribution of computing resources.
For example, some computing frameworks may occupy computing resources for a long time, and some computing frameworks may be in a starvation state for a long time, and the task operation efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for task scheduling in a distributed system
  • Method and device for task scheduling in a distributed system
  • Method and device for task scheduling in a distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0057] In the field of cloud computing, distributed task scheduling systems are very common. refer to figure 1 The architecture diagram of a distributed task scheduling system is shown. In a distributed system, multiple computing frameworks are often running, and each computing framework generates a large number of computing tasks. The computing framework requests computing resources from the task scheduler. , to make these computing tasks run. Computing resources are provided by computing nodes. Once the computing framework acquires computing resources, it runs computing tasks on the computing nodes. In the traditional scheduling method, when the task scheduler provides computing resources for the computing framework, there are...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a task scheduling method and device for a distributed system. The distributed system comprises a computing framework, computing resources used by the computing framework to execute a computing task and a cache resource pool, wherein the cache resource pool comprises affinity resources which are the computing resources firstly used by the computing framework to execute the computing task. The method comprises the following steps: receiving a resource request sent by the computing framework which has corresponding framework identifiers; judging whether the cache resource pool has the affinity resources corresponding to the framework identifiers or not; if the cache resource pool has the affinity resources corresponding to the framework identifiers, allocating the affinity resources to the computing framework for executing the computing task. The task scheduling method and the device are used for improving the operating efficiency when the computing framework executes the computing task.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a distributed system task scheduling method and a distributed system task scheduling device. Background technique [0002] Cloud Computing (Cloud Computing) is the growth, use and delivery model of Internet-based related services, usually involving the provision of dynamically scalable and often virtualized resources through the Internet. Cloud computing is a pay-by-use model that provides available, convenient, and on-demand network access and access to a configurable shared pool of computing resources (resources include networks, servers, storage, application software, and services) , these resources can be provisioned quickly with little administrative effort or interaction with the service provider. [0003] In the field of cloud computing, distributed task scheduling systems are very common. Usually, a physical machine or a virtual machine is used as a computing unit,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
Inventor 许立剑
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products