Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Distributed file system and implementation method for balancing storage loads and access loads of metadata

A distributed file and metadata technology, applied in the computer field, can solve the problem of load balancing without combined access, achieve the effect of reducing access load, improving access efficiency, and simple design

Active Publication Date: 2014-05-14
江苏博云科技股份有限公司
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Unfortunately, there is no technical solution combining access load balancing and storage load balancing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system and implementation method for balancing storage loads and access loads of metadata
  • Distributed file system and implementation method for balancing storage loads and access loads of metadata
  • Distributed file system and implementation method for balancing storage loads and access loads of metadata

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0082] This embodiment is an embodiment of the distributed file system of the present invention.

[0083] In the distributed file system of this embodiment, the module diagram is as figure 1 Shown. The distributed file system consists of three parts: client, metadata server and storage server;

[0084] The client includes a client metadata cache module and a client metadata access module;

[0085] The metadata server is allocated with metadata in the form of a metadata directory tree, and the metadata server maintains one or more metadata directory subtrees, and records:

[0086] Local metadata storage load Mcount;

[0087] The total metadata storage load TMcount of all metadata servers;

[0088] Path and metadata server mapping table PMT.

[0089] Each metadata directory subtree maintained by the metadata server corresponds to a directory node in the metadata directory tree, that is, the root node of the metadata directory subtree, and has its corresponding path.

[0090] The path and me...

specific Embodiment 2

[0093] This embodiment is an embodiment of the distributed file system of the present invention.

[0094] The difference from the first embodiment is that in the distributed file system of this embodiment, there are multiple metadata servers, which together form a metadata server cluster.

specific Embodiment 3

[0095] This embodiment is an embodiment of the distributed file system of the present invention.

[0096] The difference from the first embodiment is that in the distributed file system of this embodiment, there are multiple storage servers, which together form a storage server cluster.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of computers, and particularly relates to a distributed file system and an implementation method for balancing storage loads and access loads of metadata based on the system. As the distributed file system is designed, and a novel client-side metadata access method, a storage load balancing method of the metadata between metadata servers, and a metadata access load balancing and high availability method are implemented based on the system, access loads of the metadata servers are relieved, and at the same time, balance of the storage loads and the access loads of the metadata between the metadata servers is guaranteed.

Description

Technical field [0001] The invention belongs to the field of computer technology, and specifically relates to a distributed file system and a method for balancing metadata storage load and access load realized on the system. Background technique [0002] The term big data is being mentioned more and more by people. It is a term used to describe and define the massive amounts of data generated in the era of information explosion. The research results of the International Data Corporation (IDC) show that the amount of data generated globally in 2008 was 0.49ZB (1ZB=1024EB, 1EB=1024PB, 1PB=1024TB, 1TB=1024GB), and the amount of data in 2009 was 0.8ZB in 2010. The growth rate is 1.2ZB. In 2011, the figure was as high as 1.82ZB. By 2020, the scale of data generated in the world will reach 44 times of today. Its growth rate is equivalent to generating more than 200GB of data per person in the world each year. [0003] In this situation of rapid data growth, massive data storage technol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F9/5083G06F16/13G06F16/183
Inventor 郁岐锋花磊
Owner 江苏博云科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com