Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hadoop-based scheduling method

A scheduling method and task technology, which is applied in the field of cloud computing, can solve problems such as not being able to meet data volume requirements and general timeliness, and achieve the effect of improving timeliness and high reliability

Pending Publication Date: 2021-02-19
STATE GRID HUNAN ELECTRIC POWER +2
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the current Hadoop-based scheduling method has general timeliness and cannot meet the growing demand for data volume.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hadoop-based scheduling method
  • Hadoop-based scheduling method
  • Hadoop-based scheduling method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] like figure 1 Shown is the method flow diagram of the scheduling method of the inventive method: this Hadoop-based scheduling method provided by the present invention comprises the steps:

[0036] S1.Fair scheduler normally schedules tasks;

[0037] S2. When a node Node requests a task, judge whether there is a type of requested task, and select the Container scheduled by the Fair scheduler according to the judgment result; specifically, select the Container scheduled by the Fair scheduler by using the following steps:

[0038] When a node Node requests a task, determine whether there is a type of requested task:

[0039] If there is a type of requested task, the Container whose data is stored in the requesting node Node is preferentially selected;

[0040] If there is no type of requested task, then proceed to the judgment of step S3;

[0041] S3. Determine whether the node Node of the request task is marked, and select the Container scheduled by the Fair scheduler ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a Hadoop-based scheduling method. The Hadoop-based scheduling method comprises the following steps of: normally scheduling a task by a Fair scheduler; when a node Node requestsa task, judging whether the type of the request task exists or not, and selecting a Controller scheduled by the Fair scheduler according to a judgment result; and judging whether the node Node of therequest task is marked or not, and selecting a Controller scheduled by the Fair scheduler according to the judgment result. According to the Hadoop-based scheduling method, the timeliness of the Hadoop-based scheduling method is improved by performing localization processing on the Hadoop-based scheduling process, and the reliability of the Hadoop-based scheduling method is high.

Description

technical field [0001] The invention belongs to the field of cloud computing, and in particular relates to a scheduling method based on Hadoop. Background technique [0002] With the development of economy and technology and the improvement of people's living standards, the Internet has been widely used in people's production and life, bringing endless convenience to people's production and life. With the development of the Internet, the explosive growth of connected data terminals and users, and the exponential increase in data volume have brought great difficulties to traditional data processing methods. Because in traditional data processing, data is often processed at one terminal, which is an intensive processing method. For a large data, processing takes a long time, which is obviously unreasonable. In this case, cloud computing can be proposed. Cloud computing has many advantages, such as ultra-large scale, virtualization, high reliability, versatility, high scalabil...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4843G06F9/5083
Inventor 唐镜雯常胜陈俊唐渊陈卫民夏先喜向明范方彪徐高明邓志祥周能邵帅
Owner STATE GRID HUNAN ELECTRIC POWER
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com