A Data Fault Tolerance Method Based on Dynamic Block Code

Abstract

The invention proposes a data fault-tolerant method based on dynamic block codes, which belongs to the technical field of data storage, and specifically relates to data fault-tolerant problems in a distributed storage system. The data fault-tolerant method based on dynamic block codes is used to restore lost or invalid data. Firstly, the data to be stored is stored in blocks according to the grouping of the disks in the distributed system. When the data storage of a stripe is complete, apply DLRC encoding to the data blocks on this stripe, generate a global check block and a local check block, and store them in the disk of the check block. When a data block is found to be invalid, read the data of the nodes participating in the reconstruction, use the DLRC code to perform reverse calculation, reconstruct the lost data and store it to the disk again. The invention realizes the dynamic balance of the storage cost, the fault tolerance capability and the reconstruction cost, and is applicable to the requirements of different storage systems. In the case of consuming the same storage space, DLRC coding has high fault tolerance and low reconstruction overhead, which has good practical value.

Description

technical field [0001] The invention belongs to the technical field of data storage, and relates to a data fault-tolerant method based on a dynamic block code, in particular to the data fault-tolerant problem in a distributed storage system, and uses a data fault-tolerant method based on a dynamic block code to recover lost or invalid data. Background technique [0002] With the advent of the era of massive data, the early stand-alone systems have been unable to adapt to the rapid growth of data storage, and now more and more enterprises are beginning to adopt distributed storage systems. Since the distributed storage system generally uses a large number of cheap commercial servers interconnected through the network, it can provide strong expansion and service capabilities. However, as the scale of the cluster increases and the number of interconnected storage devices increases, failures of storage nodes occur more and more frequently. Therefore, how to ensure the reliabili...

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem that current erasure codes cannot dynamically adapt to the needs of storage systems, the present invention proposes a new type of erasure codes based on block code ideas, DLRC codes (Dynamic Local Reconstruction Codes, dynamic block codes), which are used to replace traditional data fault-tolerant technology

Images