Distributed file deletion method, device and system

Abstract

The embodiment of the invention provides a distributed file deletion method, device and system. The method comprises the steps that data deletion requests sent by a client are received and added to a processing queue, and first deletion success information is returned to the client; the data deletion requests in the processing queue are sequentially acquired, and storage capacity information of cluster nodes is updated according to the data deletion requests; data information of data needing to be deleted is determined according to the data deletion requests and stored in a database, the data information in the database is acquired every other preset time, and the data corresponding to the data information are deleted. Receiving of the data deletion request of the corresponding client and the deleted data are asynchronously processed, and therefore the waiting time of the client is effectively shortened.

Description

technical field [0001] The present invention relates to the technical field of distributed files, in particular to a method, device and system for deleting distributed files. Background technique [0002] With the rapid development of network applications, the amount of network information data is increasing, and mass data storage is becoming more and more important. The traditional local disk storage method can no longer meet the requirements of large capacity, high reliability, high performance, and horizontal expansion of existing applications. In order to meet these new requirements, network-based distributed storage systems have received extensive attention. [0003] Taking a typical distributed file system as an example, the bottom layer adopts the method of object storage. When the client performs operations such as reading, writing and deleting files, it will first communicate with the metadata node MDS, and then obtain the metadata of the target file. After the inf...

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present invention provides a distributed file deletion method and system to solve the problem that in the prior art, the input and output IO paths passed by the deletion operation and the read and write operations are the same, and this processing method takes a long time to wait for a response , the delay caused is very obvious, especially when performing batch deletion operations of a large number of small files, which may even affect the normal business of users

Images