Construction method of distributed persistent memory storage system

Abstract

The invention discloses a construction method of a distributed persistent memory storage system, which comprises the following steps of: interconnecting storage servers provided with persistent memories through an RDMA (Radio Frequency Division Multiple Access) network, and addressing the storage servers into a globally unified virtual address space; carrying out unified abstraction on common function modules of subsystems in the storage system, and constructing a unified distributed persistent shared memory framework on the global virtual address space; realizing each storage subsystem according to a basic function module provided by the distributed persistent shared memory framework so as to construct a distributed persistent memory storage system; cluster information is fed back in realtime through the cluster monitoring management module, and the distributed persistent memory storage system is assisted to work. The construction method has the advantages of being concise in software level, low in software system overhead, safe in access interface, high in performance, easy to manage and the like, and the defects that a traditional system is complex in structure and redundant infunction are overcome.

Description

technical field [0001] The invention relates to the technical field of distributed storage systems, in particular to a construction method of a distributed persistent memory storage system. Background technique [0002] Remote Direct Memory Access (RDMA) can directly transfer data to or read data from application memory without the intervention of the operating systems of both parties. RDMA-based data transfer does not need to copy data between the application program memory and the data buffer in the operating system, thus realizing zero-copy data transfer. The latest RDMA network card already supports 100Gbps network transmission bandwidth and sub-microsecond transmission delay. [0003] The new persistent memory (PersistentMemory, PM) has the following characteristics: 1) data will not be lost when power is off; 2) compared with traditional DRAM (Dynamic Random Access Memory, dynamic random access memory), its storage density is higher; 3) in the read In terms of write ...

AI Technical Summary

Problems solved by technology

However, RDMA and PM also exhibit completely different hardware characteristics from traditional Ethernet and external storage devices: RDMA can directly access remote memory without the participation of the remote CPU, which is different from the traditional socket-based data sending and receiving mode. It is completely different. At the same time, RDMA provides a wealth of transmission primitives. They are different in semantics and performance. Persistent memory is different from traditional external storage devices in terms of read and write delay asymmetry and consistency management methods. The persistent memory is directly connected to the CPU through the memory bus. Therefore, the persistent-volatile boundary is moved up from the traditional internal and external memory to between the CPU cache and the main memory. control, which brings new challenges to data consistency management on PM

[0005] At present, in order to give full play to the hardware characteristics of RDMA and reduce the overhead of PM data consistency management, existing work proposes different solutions for different storage subsystems. However, these technologies are applied to distributed persistent memory storage systems Different subsystems will lead to functional redundancy, complex architecture, and even conflicts with each other

[0006] In summary, there is currently no effective way to combine RDMA and PM organically, and it is necessary to build a high-performance, reliable, and easy-to-manage large-scale storage system

Images