Distributed file system data volume deployment method based on virtual address pool

Abstract

The invention provides a distributed file system data volume deployment method based on a virtual address pool. A node cluster or a sub-cluster is built according to different node roles of metadata nodes, data storage nodes and client side nodes in a distributed file system; a data storage volume is deployed in a mode based on the virtual IP address pool on a data node cluster to separate the deployment of a distributed file system data storage volume from physical addresses of data nodes so as to combine the deployment of the data storage volume with virtual addresses of the data node cluster; a monitoring module is deployed on an operating node of the distributed file system so as to realize real-time monitoring of the operating conditions of the node and a load; according to the conditions of the node and the load, a virtual IP borne by any node and the data storage volume mounted on one virtual address are transferred in real time in the data node cluster; meanwhile, a failure of a physical node is also isolated, so that the effect that data services of the data storage volume are not interrupted when the physical node is maintained is ensured.

Description

technical field [0001] The invention relates to the field of distributed file systems applied in the fields of cloud computing and cloud storage, and in particular to a method for deploying data volumes of a distributed file system based on a virtual address pool. Background technique [0002] With the further development of cloud computing technology and cloud storage technology application, the distributed file system as the core of its application has been rapidly applied and developed. Because cloud computing and cloud storage applications carry features such as scalable and massive storage content, the existing stand-alone file systems cannot meet the storage requirements of cloud-related services due to their limited capacity and lack of real-time scalability. ; Therefore, a distributed file system with dynamic high scalability, cluster architecture, support for high concurrency, and large capacity has become the choice of cloud computing business back-end storage devi...

AI Technical Summary

Problems solved by technology

The mass storage space of the distributed file system is constructed through the storage devices at the back end of the data node cluster. In a data node cluster with a certain number of nodes, it is a frequent phenomenon that the data storage volume cannot be accessed due to node failure. By mapping the data storage volume to The physical addresses of all data nodes and the introduction of high-availability software are only applicable to a limited number of node clusters. For clusters composed of thousands or hundreds of data nodes and larger data node clusters composed of multiple sub-clusters, data nodes appear Frequent failures, complex replacement of data nodes, long replacement time, and incomplete replacement, resulting in inaccessible data storage volumes or frequent interruption of access

Images