Data transmission method and device oriented to distributed file system

Abstract

The invention provides a data transmission method oriented to a distributed file system. The method comprises the following steps: 1. acquiring metadata information of a document to be accessed currently by a client, wherein the metadata information comprises a document size; 2.selecting an access mode of the document to be accessed currently according to whether a document size threshold value is exceeded, wherein the access mode is selected from an in-band data access mode and an out-band data access mode; and 3. acquiring document data from a file metadata service layer or a storage facility layer according to a selected access mode request. The invention also provides a corresponding data transmission device oriented to the distributed file system. Compared with the prior art, invention has the advantages that the distributed system can select a data access mode which is suitable for the accessed document in a self-adaptive mode according to an application access load, and simultaneously, performance requirements of large documents and small documents can be satisfied; and the switching of the data access mode is transparent to an application program, and any modification for the user application program is not required.

Description

technical field [0001] The present invention relates to the technical field of computer storage, and more specifically, the present invention relates to a data transmission method oriented to a distributed file system. Background technique [0002] With the continuous development of information technology, information system has played an irreplaceable role in the development of enterprises. However, with the further development of technologies such as audio, video, and images, the amount of application data has shown explosive growth. According to the research results, the total amount of global data will reach more than 988 billion GB in 2010, more than 95% of which are unstructured data, which will further stimulate the demand for distributed file systems. [0003] A typical distributed file system includes a file client layer, a file metadata service layer and a storage device layer. Wherein, the file client layer has a file system client, the file metadata service lay...

AI Technical Summary

Problems solved by technology

However, because the out-of-band data access method increases the network interaction overhead, it is not conducive to the access performance of small files

[0006] To sum up, the two types of data transmission methods in the existing distributed file system have their own defects, and it is difficult to achieve satisfactory access performance for various files with diversity at the same time.

Images