A method and system for determining resource scheduling components

A resource scheduling and component technology, applied in transmission systems, electrical components, etc., can solve the problems that the cluster resource scheduling system cannot meet, cannot be quickly located, and there are many big data components

Active Publication Date: 2020-01-07
CHINA MOBILE COMM LTD RES INST +1
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Currently, in big data applications such as web page information, network management (NMS) signaling monitoring, and business intelligence (BI), how to manage resources for data generated by different systems has the following problems: there are many big data components, and a cluster resource scheduling The system cannot meet all requirements; moreover, when there are multiple cluster resource scheduling systems, due to the complexity of big data component types, it is impossible to quickly locate which cluster resource scheduling system meets the requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for determining resource scheduling components
  • A method and system for determining resource scheduling components
  • A method and system for determining resource scheduling components

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] This embodiment provides a method for determining resource scheduling components; here, the method described in this embodiment can intelligently and quickly analyze which resource scheduling component meets the business requirements and the characteristics of business data, and due to the It can automatically load data and test various resource scheduling algorithms (that is, resource scheduling strategies), so this application saves time for testers in selecting schedulers and installing various resource scheduling frameworks, and realizes rapid poc (Proof of Concept) the purpose of the test.

[0050] specifically, figure 1 A schematic flow diagram of the implementation of the method for determining the resource scheduling component in the embodiment of the present invention; figure 1 As shown, the method includes:

[0051] Step 101: Obtain business data, and select a big data component for processing the business data;

[0052] In this embodiment, the big data com...

Embodiment 2

[0063] This embodiment provides a system for determining resource scheduling components, such as figure 2 As shown, the system includes:

[0064] An acquisition module 21, configured to acquire business data;

[0065] A screening module 22, configured to select a big data component that processes the business data;

[0066] A processing module 23, configured to control the big data component to process the business data based on the resource scheduling policy corresponding to each of the resource scheduling components in at least two resource scheduling components;

[0067] A performance analysis module 24, configured to analyze the performance of the big data components that process business data based on the resource scheduling policy of each resource scheduling component, and obtain the performance detection results of the big data components for each of the resource scheduling components;

[0068] Correspondingly, the screening module 22 is configured to select, from th...

Embodiment 3

[0082] This embodiment provides a system for determining resource scheduling components, such as image 3 As shown, the system includes six main modules, which are respectively a control module, a log data management module, a configuration module, a performance evaluation module, a resource scheduling module, and a rule library; here, in practical applications, the system can provide resource scheduling Access interface, users can add various types of resource scheduling systems (also called resource scheduling components) into the system according to actual needs. specifically,

[0083] First, the log data management module is used to complete the loading of the log; specifically, it includes two aspects of work, (1) loading the original log to the file system corresponding to the big data component through ftp, etc., so that all The big data component processes the log data; (2) filters the original log data according to requirements, and then facilitates processing of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention discloses a method for determining a resource scheduling assembly. The method comprises the following steps: obtaining service data, and selecting a big data assembly for processing the service data; controlling the big data assembly to carry out processing on the service data based on a resource scheduling policy corresponding to each resource scheduling assembly inat least two resource scheduling assemblies; carrying out performance analysis on the big data assembly for processing the service data based on the resource scheduling policy of each resource scheduling assembly to obtain a performance test result of the big data assembly for each resource scheduling assembly; and selecting a target resource scheduling assembly corresponding to the big data assembly, the performance test result of which meets a preset rule, from the at least two resource scheduling assemblies. The embodiment of the invention discloses a system for determining the resource scheduling assembly.

Description

technical field [0001] The present invention relates to resource scheduling technology, in particular to a method and system for determining resource scheduling components. Background technique [0002] With the rapid development of business and the gradual expansion of cluster scale, various computing systems, storage systems, and application systems are also created along with the development of business. However, after the scale of the cluster expands, it brings many problems, such as automatic deployment and low overall utilization of the cluster. Therefore, a cluster resource scheduling system is urgently needed to solve these problems. Here, the cluster resource scheduling system abstracts the underlying hardware to shield the heterogeneity of the hardware, such as central processing unit (CPU), memory (MEMORY), input / output (I / O) and disk ( DISK) etc. perform resource abstraction, provide unified management and scheduling of resources for various applications or serv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/02H04L67/10H04L67/1074
Inventor 陈洪岭
Owner CHINA MOBILE COMM LTD RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap