File deletion method and device for distributed file system, equipment and storage medium

Abstract

The embodiment of the invention discloses a file deletion method and device for a distributed file system, equipment and a computer readable storage medium. The method comprises the steps that after afile deletion request sent by a client side is received, when the disk space occupation value of a free directory exceeds a preset cache threshold value, the file deletion request is arranged in a pre-established delay deletion waiting queue; after it is detected that the object storage server completes the current deletion request, awakening the file deletion request from the delay deletion waiting queue, so that the object storage server executes a file deletion operation; wherein the cache threshold value is not greater than the difference value between the local cache space capacity valueof the metadata server and the cache space capacity value of the metadata server required to be occupied during normal operation of the distributed file system. The influence of a large number of file deletion actions on the normal service processing of the distributed file system can be reduced, and the read-write service performance of the distributed file system can be improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of distributed file systems, and in particular, to a file deletion method, device, device, and computer-readable storage medium of a distributed file system. Background technique [0002] With the rapid development of cloud technology and big data, the data shows explosive growth, the application of distributed file system is more and more widely, and the business scenarios used are relatively more and more. Naturally, the massive file deletion operation of distributed file system is Unavoidable scenarios in the application process of distributed file systems. [0003] Related technologies When deleting files in a distributed file system, MDS (Meta Data Controller, metadata server) is usually used to mount the metadata of the file to be deleted in a flat free directory, and then return the information that the file is deleted successfully to the client . [0004] However, the file del...

AI Technical Summary

Problems solved by technology

[0004] However, the file deletion in the free directory is processed asynchronously, and the metadata of the file to be deleted is still stored in the local cache of the MDS. The file deletion speed depends on the deletion speed of the OSD (Object-based Storage Device, Object Storage Server). If the MDS Deleting a large number of files in a short period of time will cause the metadata of these files to occupy a large MDS cache space, even exceeding the size of the MDS local cache space, seriously affecting the normal operation of other services in the distributed file system

Images