Distributed-data management method

Abstract

The invention discloses a distributed-data management method and belongs to the field of distributed storage. The technical scheme includes that scattering metadata management functions to multiple nodes, creating mapping relations, selecting an implementation structure that a common multi-fork tree and a hash table are combined in metadata tree structure design, adding full path fields to the data structure of metadata, and writing new data prior to logs in data writing; after file metadata is acquired, acquiring the storage location of file data in a mapping mode; meanwhile, supporting file metadata copies and file data copies, adopting the different mapping relations to ensure that the copies are distributed to the different nodes when the file metadata copies or the file data copies are used, and enabling a copy storage terminal to take over a main storage end in operation rapidly when the file metadata or the file data is written and the main storage end fails. By the arrangement, performance and reliability of distributed data management can be effectively improved.

Description

technical field [0001] The invention belongs to the field of distributed data storage, and more specifically relates to a distributed data management method. Background technique [0002] Distributed data management refers to accessing data on other nodes through the network in a manner similar to a local file system. [0003] Accessing a file actually corresponds to accessing each block of the file. After obtaining the metadata information of the file, it is necessary to continue to obtain the block information of the file. The traditional method is based on the block distribution table, that is, a block distribution table is maintained in the memory, and the storage location of the file blocks is stored in the table, and the file block information is obtained by querying the block distribution table. [0004] When accessing a file, the metadata information of the file is obtained first, and then the corresponding file data is accessed. Metadata refers to data describing ...

AI Technical Summary

Problems solved by technology

[0007] Aiming at the above defects or improvement needs of the prior art, the present invention provides a distributed data management method, the purpose of which is to disperse the metadata management function of distributed data management to multiple nodes and establish a mapping relationship; Metadata copies and file data copies ensure that the copies are distributed to different nodes. When reading and writing file metadata or file data, when the main storage end fails, the copy storage end can quickly take over the work of the main storage end, thereby solving the existing The memory, computing and other overheads brought about by metadata management will be borne by a specific node, and the resources and performance of the system will be limited, that is, the problem of insufficient reliability of data copy distribution

Images