Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method based on distributed file system and server

A distributed file and file processing technology, applied in the field of communication, can solve the problems of large amount of file data and great impact on data processing performance.

Active Publication Date: 2014-02-19
BEIHANG UNIV
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the prior art, because the first client computer accesses the server through the network, and then processes the data including files or directories in the second client computer through the network between the server and the second client computer, and often the file The amount of data is large, therefore, in the existing distributed file system, the performance of data processing is greatly affected by the network conditions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method based on distributed file system and server
  • Data processing method based on distributed file system and server
  • Data processing method based on distributed file system and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] figure 1 A schematic flowchart of a data processing method based on a distributed file system provided by an embodiment of the present invention, such as figure 1 shown, including:

[0021] 101. The server receives a file processing command sent by the first client.

[0022] Wherein, the file processing command is used to indicate the data to be processed, the operation to be performed on the data, and the second client to which the data belongs; the data includes at least one of a file and a file directory; the file directory is used to indicate that the file is in the second The storage location in the client.

[0023] 102. The server queries the attribute cache of the data indicated by the file processing command.

[0024] Wherein, the attribute cache is used to indicate the metadata of the data; the metadata includes: at least one of data volume, last modification time, last access time and creation time.

[0025] Judging whether the attribute cache of the data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing method based on a distributed file system and a server. The method includes the steps that file processing commands for indicating data needing processing are received, attribute caches of the data indicated by the file processing commands are queried, whether attribute caches of data copies corresponding to the data are the same as the queried attribute caches or not is judged, if yes, operation indicated by the file processing commands is executed on the data copies to generate a first operation result, and the first operation result is sent to a first client. Due to the fact that the attribute caches of the data and the data copies corresponding to the data are prestored, the number of the times that the first client has access to the server through a network and then processes data, including files or contents, in a second client through a network between the server and the second client is reduced, and the technical problem that in the distributed file system, data processing performance is greatly affected by network conditions is solved.

Description

technical field [0001] The invention relates to communication technology, in particular to a data processing method and server based on a distributed file system. Background technique [0002] Distributed File System (Distributed File System), including a server and at least two clients. The server is set in the cloud, and is connected to each client computer through the network, and each client computer can also access each other through the network. In the distributed file system, the second client computer publishes a file directory that allows the first client computer to access, and the storage location of the file indicated by the file directory is located on the physical node where the second client computer is located, so that the first client computer can access the file through the server. The files under the file directory are processed including read operation and write operation, and the file directory is opened and closed. [0003] In the prior art, because t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F12/08
Inventor 沃天宇康俊彬王聿达张本龙马晓航
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products