System and method for implementing high-efficiency security memory

Abstract

The invention discloses a system for realizing efficient safe storage and a method thereof. The invention comprises the steps as follows: a storage server, a protocol server, a coding server, a decoding server and a metadata server are arranged; during writing operation, the protocol server writes initial data for writing into the storage server and at the same time indicates the coding server to encode the data for writing, the coding server encodes the data to generate redundant data and assigns the redundant data to the appointed storage server, and after writing is finished, basic information of the written file data is stored in the metadata server; during reading operation, the protocol server accesses the metadata server to obtain the storage position of the initial data for reading and obtains the data from the storage position of the data to be combined into the file data; when the initial data can not be read normally, the metadata server is accessed, the storage position of the redundant data is obtained, and the redundant data is read into the decoding server. The invention can effectively improve the efficiency and the reliability of data storage.

Description

technical field [0001] The invention relates to the technical field of safe data storage, in particular to a system and method for realizing efficient and safe storage. Background technique [0002] In the field of data storage, access efficiency, storage efficiency, reliability, security, platform compatibility, scalability, and ease of management are the main directions of storage system design, which are directly related to the user's direct cost, maintenance cost, The upgrade cost and the value preservation of the equipment, etc. [0003] The security and effectiveness of data storage are headaches for large enterprises and Internet service providers, especially when service providers such as online backup, online storage, network hard drives, cloud computing, and cloud storage are surging. [0004] Over the past 30 years, storage methods have gone through the following typical periods: direct-attached storage (DAS) period, redundant array of independent disks (RAID) + ...

AI Technical Summary

Problems solved by technology

However, for operators and service providers characterized by storage, the cluster file system will still bring pressure on cost, security, and ease of use. The main disadvantage is that the cluster file system is characterized by multiple copies of data Redundant mechanism, low storage efficiency; cluster file system will occupy more bandwidth, large-capacity and high-density data application environment is more sensitive to bandwidth occupation; cluster file system is generally only suitable for application in the local area network, cross-wide area network application is a real problem; The security of network transmission is difficult to guarantee, and the security management of remote files is also a problem, especially sensitive data

[0008] In the establishment of a redundant coding system, the problems that need to be solved include: (1) the calculation will inevitably bring time overhead, and the time delay will affect the processing capacity of the system to a certain extent; (2) the encoded data cannot be limited Access through the only channel, such as RAID cards and NAS, are highly dependent on the data read / write head, and the access channel will cause single-node failure; (3) The encoded data has certain topological rules in storage, and data access requires Strong predictability can ensure that data can be read quickly; (4) The storage system requires strong scalability and can be configured on demand; (5) The coding system must be scalable in terms of storage, computing, and deployment. The characteristics of separation, that is, the above elements cannot be coupled together; (6) The processing order of data is consistent with the physical storage order

[0079] The Parity algorithm has been widely used in RAID and other storage systems. One of its important features is the use of XOR algorithm, redundant coding will not cause overflow, and the algorithm is simple, easy to implement on the chip system SOC; and the Reed-Solomon algorithm It has been decades, but its algorithm consumes a lot of calculations. Since matrix calculations and their inverse operations take a lot of time, it will reduce the efficiency of I / O for applications characterized by storage. Not easy to implement on SOC system

Images