Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Performance optimization method, device and equipment and computer readable storage medium

An optimization method and performance technology, applied in the communication field, can solve problems such as uneven pressure distribution of HDFS and degradation of HDFS reading performance, and achieve the effects of avoiding uneven pressure distribution, improving reading performance, and reducing pressure

Pending Publication Date: 2020-05-15
ZTE CORP
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to provide a performance optimization method, equipment and computer-readable storage medium, aiming to solve the problem of HDFS pressure distribution caused by the fact that the client always reads data from the data node closest to it in HDFS. Uniform, the technical problem that the read performance of the entire HDFS drops

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Performance optimization method, device and equipment and computer readable storage medium
  • Performance optimization method, device and equipment and computer readable storage medium
  • Performance optimization method, device and equipment and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0041] Due to existing HDFS client always reads data from the data node closest to it at present, the pressure distribution of HDFS that causes is uneven, the technical problem that the reading performance of whole HDFS declines, the present invention provides a kind of solution, by receiving After receiving the data read request sent by the client, obtain the data node where the data block corresponding to the data read request is located; after obtaining the preset sorting strategy corresponding to the data node, sort the data node according to the sorting strategy to obtain the data A node list: return the data node list to the client, so that the client can determine the data node that provides the read data block service according to the data node list. It avoids that the client always reads data blocks from the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a performance optimization method, device and equipment and a computer readable storage medium. The method comprises the steps: obtaining a data node where a data block corresponding to a data reading request is located after the data reading request transmitted by a client is received; obtaining a preset sorting strategy corresponding to the data nodes, and sorting the data nodes according to the sorting strategy to obtain a data node list; and returning the data node list to the client, so that the client determines a data node for providing a data block reading service according to the data node list. According to the invention, the client is prevented from always reading the data block from the data node closest to the client, the pressure of the data node closest to the client is reduced, the uneven pressure distribution of the HDFS is avoided, and the reading performance of the whole HDFS is improved.

Description

technical field [0001] The present invention relates to the technical field of communications, and in particular to a performance optimization method, device, equipment and computer-readable storage medium. Background technique [0002] Hadoop is an open source distributed computing platform. Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a core component of Hadoop and is currently widely used in big data services. HDFS is mainly responsible for storing file data in Hadoop. Files on HDFS are stored in blocks. A data block is an abstraction that is a logical unit of file storage processing. A data block usually has multiple copies to increase data security, and multiple copies of the data block are usually stored in different data nodes, and these data nodes may be in the same rack or in different racks. When a client in HDFS wants to read a file, it usually prefers to read the copy of the data block in the data node closest to it, such as reading...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F9/50
CPCG06F9/5027G06F9/50G06F16/182
Inventor 胡晓东张东涛辛丽华
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com