Processing method and system for metadata based on authorization manner

Abstract

The invention discloses a processing method and a system for metadata based on an authorization manner, which comprises the steps of application, transmitting, visiting and releasing, wherein in the application step, a client side transmits an application for obtaining the authorization of the metadata to a metadata server; in the transmitting step, after receiving the application, the metadata server transmits the authorization of the metadata to the client site; in the visiting step, after obtaining the authorization of the metadata, the client side directly visits metadata storage resources logically isolated from the metadata server to obtain the metadata; and in the releasing steps, the client side releases the authorization of the metadata. The processing method and the system have the beneficial effects that the effect that the authorized client side directly reads and manages the metadata is realized, and the authorized client side ensures the consistence of the metadata without periodically disabling a metadata cache to achieve the purposes of reducing the network interaction, shortening a metadata IO (Input / Output) path and improving the load capacity and the performance of the whole system.

Description

technical field [0001] The invention relates to the cluster file system technology, in particular to a metadata processing technology of the cluster file system. Background technique [0002] In recent years, more and more high-performance computers adopt cluster architecture. The global shared file system technology on the cluster, that is, the cluster file system technology, is also receiving more and more attention. At present, a common cluster file system consists of a metadata server, a shared storage server, and a client. The client obtains metadata from the metadata storage resources of the shared storage server through the metadata server. In the cluster file system, the working principle of client applications accessing files is as follows: [0003] Step 1: Parse the path; [0004] Step 2: Obtain file layout information; [0005] Step 3: Read file data; [0006] Step 4: Repeat steps 2~3 until all the required data are read. [0007] Among them, step 1 further ...

AI Technical Summary

Problems solved by technology

[0015] The technical problem to be solved by the present invention is that in the scenario where large-scale small files are read and accessed concurrently, the existing technology cannot effectively solve the bottleneck problem of metadata access, that is, there are a large number of network interactions between clients and metadata servers

Images