Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed shared file system based on block storage

A file system and file sharing technology, applied in file systems, file access structures, special data processing applications, etc., can solve problems such as inconsistency, impact on storage access, performance bottlenecks of transit nodes, etc., and achieve high-performance parallel reading and writing, hanging The loading method is simple, and the effect of parallel reading and writing is realized.

Active Publication Date: 2017-06-09
CETC CHINACLOUD INFORMATION TECH CO LTD
View PDF13 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the combination of computing pool and data carrier storage is varied, not uniform, and there are many problems
The birth of the distributed shared file system based on block storage solves many defects in the traditional system: First, it cannot be mounted and read and written by multiple nodes at the same time
Second, the mounting method is cumbersome. After mounting to the node (transit node) through the iscsi protocol, format the local file system, export it into a traditional shared file system such as NFS or cifs, and then mount it to multiple nodes (computing nodes in the cluster) Realize the sharing function
3. There is a single point of failure problem in the transit node. If a downtime occurs, it will affect the storage access of computing nodes in the entire cluster.
Fourth, there is a performance bottleneck in the transit node. All data reads and writes must be converted by the transit node and finally written to storage. The network interface, CPU, memory and other configurations of the transit node will become bottlenecks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed shared file system based on block storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0010] The preferred embodiments of the present invention are given below in conjunction with the accompanying drawings to describe the technical solution of the present invention in detail.

[0011] like figure 1 As shown, the block storage-based distributed shared file system of the present invention includes a metadata module, a cluster management module, a node manager, a storage heartbeat, a network heartbeat, a file system isolation module, a distributed lock management module, a user space, and a kernel Space interface, standard file system interface, the metadata module is responsible for the synchronization of metadata between nodes. Since each node reads and writes data in parallel, the amount of metadata is huge, so the metadata must be synchronized quickly to achieve the purpose of data sharing; cluster The management module is distributed on each mount node and is mainly used for cluster management. Since the distributed shared file system is a cluster file system...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed shared file system based on block storage. The system comprises a metadata module, a cluster management module, a node manager, a storage heartbeat wire, a network heartbeat wire, a file system isolating module, a distributed lock management module, a user space and kernel space interface and a standard file system interface, wherein the metadata module is responsible for the synchronization of nodes of the metadata. All the nodes share the read-write data in parallel, so that the purpose of data sharing can be achieved by quickly synchronizing the metadata. According to the invention, the multipoint simultaneous mounting is realized; the mounting mode is simple; no transfer node is required; after the nodes in the cluster are directly mounted and stored in blocks, the distributed shared file system can realize a data sharing function; no single point failure problem exists; any nodes in the cluster have no influence on a cluster system; a calculating node in each cluster can directly access the sharing storage; and the high-performance parallel read-write is realized.

Description

technical field [0001] The invention relates to a shared file system, in particular to a distributed shared file system based on block storage. Background technique [0002] Due to the emergence of cloud computing, the computing power of servers is no longer limited to a single node. Computing pools composed of cluster nodes provide virtualization, cloud desktop and other business carriers and become the mainstream. However, there are many forms of combining computing pools and data carrier storage, which are not uniform and have many problems. The birth of the distributed shared file system based on block storage solves many defects in the traditional system: First, it cannot be mounted and read and written by multiple nodes at the same time. Second, the mounting method is cumbersome. After mounting to the node (transit node) through the iscsi protocol, format the local file system, export it into a traditional shared file system such as NFS or cifs, and then mount it to m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/176G06F16/182
Inventor 丁中术谢光伟刘斌
Owner CETC CHINACLOUD INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products