A reliable flash memory storage method and system based on local and distributed collaborative design

Abstract

The invention discloses a local and distributed collaborative design reliable flash memory storage method and system, and the method comprises the steps: enabling a flash memory conversion layer to send flash memory reliability information to a host when flash memory equipment is connected to a host system, and enabling error data information to be sent to the host when the flash memory equipmentreads data errors; the host carries out data recovery on the error data, obtains correct data from a remote copy or an erasure code by utilizing a distributed fault-tolerant mechanism to help recoverthe error data, obtains the correct data from a party completing data recovery first, and sends the correct data to the distributed storage system; and when the distributed fault-tolerant mechanism cannot provide the correct data required for recovering the error data, the distributed storage system obtains the original data from the flash memory device where the correct data copy is located so asto recover the error data. The method can comprehensively manage the reliability mechanism of the distributed storage system and the local flash memory device, reduces the read operation delay of thesystem, improves the local data recovery efficiency of the flash memory device, and enhances the reliability of the storage system.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a reliable flash memory storage method and system for local and distributed collaborative design. Background technique [0002] Flash memory (Flash Memory, FM for short) is an electronic erasable programmable memory. Compared with traditional disk media, flash memory has the characteristics of high read and write bandwidth, low access delay, low power consumption, and strong stability. Popular in data centers, PCs, and mobile devices. Flash memory is read and written in units of pages. When flash memory rewrites a page, it needs to be erased first. Flash memory is erased in units of blocks. A flash memory block contains hundreds of flash memory pages. A unit of a flash memory has a limited number of erasing (Programming / Erase, P / E) operations, that is, each flash memory unit has a limited lifetime. [0003] The Solid State Drive (SSD for short) built on the basis of flash mem...

AI Technical Summary

Problems solved by technology

Distributed storage systems and flash memory devices both have reliability guarantee mechanisms, and there is redundancy in both functions, resulting in a waste of resources. In addition, in the traditional design of reliability mechanisms, distributed systems and flash memory devices are isolated from each other and cannot Make full use of information for collaborative design

For example, the nodes in the current distributed system are interconnected through a high-speed network, and the network delay is very low. Accessing remote data may be faster than local error handling.

When the local flash memory device fails, only the time-consuming local recovery mechanism is used, resulting in an increase in system access delay

At the same time, the distributed system cannot obtain the reliability information of the flash memory device, and cannot combine this information to optimize the data layout

The information between each flash memory device cannot interact, and when all copies of the data cannot be recovered, the information of all copies cannot be comprehensively utilized, resulting in data loss

Images