Distributed file storage method based on ShardingSphere and Fastdfs

Abstract

The invention relates to the technical field of data storage, in particular to a distributed file storage method based on ShardingSphere and Fastdfs (Fastdfs). The invention provides a distributed file storage method based on ShardSphere and Fastdfs, a distributed file storage architecture is formed by integrating components of a sub-library, a sub-table, a database and the Fastdfs, a file service API (Application Program Interface) is developed on the basis of the architecture, functions of storage, query, deletion and the like are provided, the storage function mainly uses a Fastdfs cluster to realize distributed storage of massive files, and the distributed file storage method has the advantages of being simple in structure, convenient to operate and high in practicability. And the query and deletion function mainly realizes the query and deletion of the file through massive file meta-information stored in the ShardingSphere and Mysql cluster. Distributed storage realized by the method mainly comprises a file data storage cluster based on Fastdfs, a database cluster based on ShardingSphere middleware and Mysql file meta-information storage, and a cluster based on Nginx and application service, and distributed expansion and load balancing can be realized from a data layer and a service layer.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a distributed file storage method based on ShardingSphere and Fastdfs. Background technique [0002] With the advent of the era of big data, the number of Internet pictures, files, and videos has also increased at an explosive rate. The processing of files has become a huge challenge for various business systems. All functions and files in traditional web applications are on the same computer. On the server, after the number of files reaches a certain level, there are a series of problems such as serious degradation of access performance, difficulty in expanding file storage space, and difficulty in sharing files between systems. As a lightweight distributed file system, Fastdfs has the characteristics of high performance, scalability, load balancing, etc. It is suitable for storage of small and medium files in a big data environment; ShardingSphere is a relational database ...

AI Technical Summary

Problems solved by technology

[0002] With the advent of the era of big data, the number of Internet pictures, files, and videos is also increasing at an explosive rate. The processing of files has become a huge challenge for various business systems. In traditional web applications, all functions and files are on the same platform. On the server, after the number of files reaches a certain level, there are a series of problems such as serious decline in access performance, difficulty in expanding file storage space, and difficulty in file sharing between systems.

Images