File request processing method and system

Abstract

The invention discloses a file request processing method and system. A total memory space is divided into multiple memory pools according to a first preset rule, each memory pool is bound to one corresponding metadata processing thread, each metadata processing thread is bound to one corresponding service core, correspondence relations between all metadata and all the metadata processing threads are established according to a second preset rule, a directory table is generated according to each metadata identifier and the corresponding thread number, a metadata request is accepted, metadata identifiers of all target metadata in the metadata request are determined, target metadata processing threads corresponding to the target metadata are searched through the directory table according to the metadata identifiers of the target metadata, all the target metadata are stored to the memory pools bound to the corresponding target metadata processing threads respectively, and multi-thread cache performance and memory access performance are improved.

Description

technical field [0001] The invention relates to the field of metadata cache, in particular to a method and system for processing file requests. Background technique [0002] With the rapid development of cloud storage applications, especially the rapid development of Internet services, the application of massive small files puts forward higher requirements on the metadata performance of distributed file systems. In general, a metadata cluster manages a large amount of file metadata information, requiring the use of a large memory capacity space. In this way, there will be competition and serious cache performance problems in the use of memory space by multiple CPUs and multi-cores. [0003] On the one hand, CPU locks and core locks cause concurrency to decrease, and the system processing performance is not high; on the other hand, metadata data processing performs metadata retrieval and modification operations in a large memory space, which will cause the core hardware multi...

AI Technical Summary

Problems solved by technology

[0003] On the one hand, CPU locks and core locks cause concurrency to drop, and the system processing performance is not high; on the other hand, metadata data processing performs operations such as metadata retrieval and modification in a large memory space, which will cause the performance of the core hardware multi-level cache to be very low. Difficult to perform, TLB performance and cache performance are poor, and ultimately it is difficult for computer hardware to effectively perform

Images