System and method for ensuring data validity in parallel network file system

A network file system and data validity technology, applied in transmission systems, electronic digital data processing, special data processing applications, etc., can solve problems such as data validity guarantee obstacles and inability to accurately determine which file a prefetched data page belongs to. , to achieve the effect of improving performance

Inactive Publication Date: 2018-03-30
INST OF COMPUTING TECH CHINESE ACAD OF SCI +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, compared with metadata prefetching, the biggest difficulty in data prefetching is that even with good physical locality, it is impossible to accurately determine which file the prefetched data page belongs to, and it may even prefetch files in other directories. data pages, which creates a significant barrier to extending directory authority to "data validity assurance"

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for ensuring data validity in parallel network file system
  • System and method for ensuring data validity in parallel network file system
  • System and method for ensuring data validity in parallel network file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, but not as a limitation of the present invention.

[0042] Such as figure 1 Shown is a schematic diagram of version number marking data validity.

[0043] The version number is a timestamp that distinguishes different read-only directory authorizations for the same client. It can not only distinguish the authorization between different directories, but also distinguish multiple authorizations of the same directory. When the metadata server grants the directory authorization to the client, it also marks the version number of the authorization. When the client directory authorization is recalled, the version number becomes invalid at the same time. After obtaining authorization next time, obtain a new version number.

[0044] The version number identifies invalid data in the client cache. During the hold of the read-only directory authorizat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and a method for ensuring data validity in a parallel network file system. The system comprises: a client, which is used for sending a read-only directory authorization application, receiving the granted read-only directory authorization, and marking the read-only directory version number, and access the file in the read-only directory on the disk and the data page of the file; the metadata server is used to receive the read-only directory authorization application sent by the client, and grant the client read-only directory authorization; the client Return the read-only directory authorization to the metadata server after completing the access, and clear the version number of the read-only directory.

Description

technical field [0001] The invention relates to a cache validity mechanism after pre-reading data between files in a parallel network file system, in particular to a system and method for ensuring data validity in a parallel network file system. Background technique [0002] With the advent of the era of big data, the amount of global data information is increasing rapidly. There are more and more small-sized files in fields such as e-commerce, social networking, and scientific computing. According to the 2007 statistics of the Pacific Northwest National Laboratory of the United States, among the more than 12 million files stored internally, more than 80% of the files are smaller than 1MB, and more than 50% of the files are smaller than 32KB. In a sense, there is currently no purely large file application. Human beings are gradually entering the "era of massive small files". [0003] Parallel Network File System (pNFS) adopts the separation structure of metadata and data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
CPCG06F16/182H04L67/568
Inventor 杨洪章张建刚张军伟刘健
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap