Erasure code storage and reconfiguration optimization method based on redirect-on-write

An optimization method and redirection technology, applied in the direction of response error generation, redundant code error detection, etc., can solve the problems of increased reconstruction time, reduced system reliability, increased write request response time, etc., and improved reliability. performance, ensuring mutual independence, optimizing the effect of refactoring performance and user response time

Active Publication Date: 2014-02-26
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. The process of writing invalid data nodes and the process of reconstructing invalid data are carried out at the same time. The two processes compete with each other for resources such as network bandwidth, disk, and memory, and the reconstruction time increases accordingly, thereby reducing system reliability.
[0006] 2. The user's write request involves three operations: recovery of invalid data, writing of new data, and update of verification data, so the response time of the user's write request will also increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Erasure code storage and reconfiguration optimization method based on redirect-on-write
  • Erasure code storage and reconfiguration optimization method based on redirect-on-write
  • Erasure code storage and reconfiguration optimization method based on redirect-on-write

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and exemplary embodiments. It should be understood that the exemplary embodiments described here are only used to explain the present invention, and are not intended to limit the applicable scope of the present invention.

[0041] Below at first explain and illustrate with regard to the technical terms of the present invention:

[0042] Write penalty: In the process of writing a data node, due to the change of the content of the data block in the data node, according to the encoding and storage method of the erasure code, the data block corresponding to the location of the check node will also change accordingly, bringing additional Checkpoint write operations. like figure 1 As shown in the (k+r, k) erasure code storage cluster disk diagram, the disk array contains...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an erasure code storage and reconfiguration optimization method based on redirect-on-write. The method includes: redirecting data, written in failure data nodes, to an RS array composed of survival node free spaces. The data redirecting process and the data migration process, including failure data node reconfiguration, redirected data migration and check data updating caused by migration, are processed independently, the two processes have fewer competitions for resources such as disk, memory and network bandwidth, the background reconfiguration process is accelerated, and foreground user access performance is optimized.

Description

technical field [0001] The invention belongs to the field of computer storage, and more specifically relates to an optimization method for erasure code storage reconstruction based on write redirection. Background technique [0002] Inexpensive redundant disk array RAID (Redundant Array of Independent Disk) is to connect multiple disks to form a storage device with certain fault tolerance. Logically, multiple disk drives constituting a RAID can be regarded as one disk drive, and each disk can work simultaneously to improve I / O parallelism. Most RAIDs provide a certain verification technology, and when a certain amount of disk data is lost, the lost data can be decoded to achieve the purpose of fault tolerance. Generally, data recovery operations and user I / O interact. On the one hand, in the process of recovering lost data, the read and write performance of the disk array will be reduced; on the other hand, compared with the offline reconstruction mode, the online reconstr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/10
Inventor 黄建忠曹强谢长生梁先海王艳群
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap