Directory reading method of distributed storage system and client side

Abstract

The invention provides a directory reading method of a distributed storage system and a client side. The method includes the steps of obtaining a reading request issued by a service side for a target directory, determining the directory size of the target directory, judging whether the directory size exceeds a preset threshold or not, if yes, issuing corresponding pre-reading operation to a metadata server in the distributed storage system for part of directory entries of the target directory so as to read the corresponding directory entries in the metadata server and storing the directory entries in a local cache, responding to the reading request through the directory entries in the local cache, and issuing the pre-reading operation to the metadata server again for the rest of directory entries in the target directory till the reading request is completely responded to if the current directory reading procedure in the local cache meets preset conditions. The scheme does not need waiting time, and thus the sending speed of the directory on the metadata server is increased.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a directory reading method and a client of a distributed storage system. Background technique [0002] In the contemporary era of rapid development of information technology, the amount of data is increasing, and distributed storage has also emerged as the times require. A distributed storage system stores data dispersedly on multiple independent devices. Traditional network storage systems use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses the location server to locate and store information. It not only improves the reliability, availability and access efficiency of the...

AI Technical Summary

Problems solved by technology

[0005] In the current distributed storage system, there are more and more massive data, accompanied by large directories, and the number of files in a single directory reaches hundreds of thousands, millions or even tens of millions; due to the increasing amount of data, business The operation of reading the directory during access takes longer and longer, giving users a poor application experience

Images