Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Error resilient coding method for high-efficiency data reading

A technology of data reading and error-tolerant encoding, which is applied in the direction of error prevention, digital transmission systems, electrical components, etc., and can solve the problems of large communication volume for data repair, low data reading performance, and high decoding overhead.

Active Publication Date: 2014-04-23
NAT UNIV OF DEFENSE TECH
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it still has the problem of downloading a large amount of data when accessing a single raw data block
[0004] For a distributed storage system based on erasure codes, in the case of consistent storage overhead, when some nodes fail, the existing erasure code technology has problems such as large data repair traffic and high decoding overhead, which leads to poor data reading performance. Low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Error resilient coding method for high-efficiency data reading
  • Error resilient coding method for high-efficiency data reading
  • Error resilient coding method for high-efficiency data reading

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention is based on intersecting zigzag sets codes (IZS codes) precise regenerative-level composite code - IZSHC code, which can significantly improve the data reading performance in case of node failure. The specific implementation is as follows:

[0053] 1. The construction process of IZSHC code

[0054] Divide a file of size M into k original data blocks of equal size, and sequentially divide them into s groups; these groups are called original data groups (original groups), and each group contains k / s original data blocks and sequentially Numbering, each block is sequentially divided into equal-sized α=2 m data slices (m=k / s-1), and numbered in numerical order; then these original data groups are assigned to different encoding groups according to the structure of the hierarchical code, and the original data blocks are used in the groups to generate check data blocks, It is divided into two types: row block and zigzag block. Each check data block is co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an error resilient coding method for high-efficiency data reading. The error resilient coding method comprises a method for coding and constructing IZSHC (Intersecting Zigzag Sets Hierarchical Codes) and a method for reading failure data under IZSHC, wherein the method for coding and constructing IZSHC refers to implementing redundant processing on to-be-read original data, i.e. coding an original document to generate redundant data blocks; the redundant data blocks are divided into original data blocks and checkout data blocks; the method for reading the failure data under IZSHC refers to reading decoding the failure data for recovery by utilizing the redundant data blocks when reading failure occurs to the original data blocks. According to the error resilient coding method, based on the IZSHC, the data reading performance in the case of node failure can be obviously improved.

Description

technical field [0001] The invention relates to a fault-tolerant coding method for efficient data reading, which belongs to the field of distributed storage. Background technique [0002] At present, with the continuous expansion of distributed systems, especially cloud computing systems, server failures in the system have become normal, which seriously affects the reliability of data storage. For storage reliability issues, cloud computing systems usually use data redundancy technology to improve data persistence and availability. Currently, the most widely used data redundancy technology in practical application is the data redundancy technology based on replication. The copy redundancy technology copies the original data file into n copies and distributes them to different network nodes; when a data node fails, the available node is used to recover the failed data. However, the copy-based data redundancy scheme greatly increases the storage cost overhead, and it is diff...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L1/00H04L29/08
Inventor 黄震游鹏飞彭宇行吴泉森牛爱民李明昊李慧方长江马嫣汪昌健
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com