Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for adjusting number of nodes in system

A technology for adjusting devices and adjusting methods, applied in multi-programming devices, resource allocation, etc., can solve problems such as waste of node equipment resources, insufficient node equipment resources, and the inability to dynamically adjust the number of nodes, and achieve the effect of solving resource shortages

Inactive Publication Date: 2016-11-23
ZTE CORP
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main technical problem to be solved by the present invention is to provide a method and device for adjusting the number of nodes in the system, which can solve the waste of node equipment resources caused by the dynamic adjustment of the number of nodes in the current Hadoop system or the technology of insufficient node equipment resources in the Hadoop system question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for adjusting number of nodes in system
  • Method and device for adjusting number of nodes in system
  • Method and device for adjusting number of nodes in system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0069] This embodiment provides a method for adjusting the number of nodes in the Hadoop system, such as figure 1 As shown, the following steps may be included:

[0070] Step 101: Receive current hardware usage status information sent by each node device in the cluster, where the node device is a started node device.

[0071] In this embodiment, the cluster is a Hadoop cluster, and each node device in the cluster needs to collect its own hardware usage status information, and then send it out. In this embodiment, each node device in the Hadoop cluster is a node device that has been started, and each node device is installed with HDFS components after startup, so that Hadoop can perform data access and other processing.

[0072] Preferably, the hardware usage status information in this embodiment may include: the current disk space usage rate of the device (ie the current disk space usage percentage of the device), the current CPU usage rate of the device (and the current CPU ...

Embodiment 2

[0118] Such as image 3 As shown, the present embodiment provides a method for adjusting the number of nodes in the Hadoop system, which is applied to the node devices in the Hadoop system cluster, including the following steps:

[0119] Step 301: After the node device is started, collect hardware usage status information of the node device itself.

[0120] After the node device in the cluster is started, the method of this embodiment can collect the hardware usage status information of the node device, for example including: at least one of the disk space usage rate of the device, the current CPU usage rate of the device, and the current memory usage rate of the device.

[0121] Preferably, a data conversion table can also be established for the collected hardware usage status information, and the hardware usage status information is processed based on the data conversion table to form a data table.

[0122] Step 302: Send the collected hardware usage status information, so ...

Embodiment 3

[0128] Such as Figure 4 As shown, the present embodiment provides a device for adjusting the number of nodes in the Hadoop system, including: a receiving module 401, an analyzing module 402 and a processing module 403;

[0129] The receiving module 401 is configured to receive current hardware usage status information sent by each node device in the cluster, where the node device is a started node device;

[0130] The analysis module 402 is configured to acquire, according to the received hardware usage status information, indicator information used to describe the current usage status of the cluster;

[0131] The processing module 403 is configured to adjust the number of activated node devices in the cluster according to the index information.

[0132] preferentially, as Figure 5 As shown, the processing module 403 in this embodiment includes: a judgment module 4031 and an adjustment module 4032;

[0133] The judging module 4031 is configured to judge whether the device...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for adjusting the number of nodes in a system. The method, provided by the invention, comprises the following steps: receiving own current hardware use condition information, sent by node equipment, in a cluster; acquiring index information for describing the current use condition of the cluster according to the received hardware use information; adjusting the number of the activated node equipment in the cluster according to the index information. According to the method and the device for adjusting the number of the nodes in the system, the technical problem that in the prior art, as the number of the nodes cannot be dynamically adjusted in a Hadoop system, the node equipment resources are wasted, or the node equipment resources in the Hadoop system are insufficient is solved.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a method and device for adjusting the number of nodes in a system. Background technique [0002] Hadoop is an open source software framework capable of distributed processing of large amounts of data. The storage core of Hadoop is the distributed file system (HDFS). HDFS is suitable for running on general-purpose hardware and needs to be deployed on a large number of devices to support large-scale data sets and high-throughput data access, and to achieve high fault tolerance. A large number of devices deployed by HDFS form a Hadoop cluster. [0003] However, the number of nodes in the current Hadoop system is defined at the beginning of use, and cannot be dynamically reduced or increased according to the actual data volume, resulting in unnecessary waste of node equipment resources or technical problems of insufficient node resources in the Hadoop system. Content...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
Inventor 刘建鹏尤元建
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com