Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and equipment for locally and randomly pre-reading distributed file system file

A distributed file and system file technology, applied in the computer field, can solve problems such as failure to achieve expected results, partial random reading, etc., and achieve the effect of improving pre-reading performance and avoiding disk pressure

Active Publication Date: 2020-09-04
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the read-ahead mechanism exists on the distributed file storage server, but it only occurs when the server receives sequential IO. At present, software parallel processing has been widely used. After the user reads sequentially and is forwarded in parallel by the protocol software, the storage server receives The IO exhibits local random read characteristics
At present, pre-reading cannot achieve the expected effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and equipment for locally and randomly pre-reading distributed file system file
  • Method and equipment for locally and randomly pre-reading distributed file system file
  • Method and equipment for locally and randomly pre-reading distributed file system file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0033] Based on the above purpose, the first aspect of the embodiments of the present invention proposes an embodiment of a method for partial random read-ahead of files in a distributed file system. figure 1 Shown is a schematic flow chart of the method.

[0034] Such as figure 1 As shown in , the method may include the following steps:

[0035] S1 Create a read-ahead structure pointer in the file operation handle. When the file is opened, create a read-ahead data structure, save the random window fw and the maximum read-ahead length max_bs in the file read-ahead data structure, and the read-ahead data structure pointer is in the handle corresponding Saved in the data structure, when the file is clos...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and equipment for locally and randomly pre-reading a distributed file system file. The method comprises the following steps of: creating a pre-reading structure pointerin a file operation handle; in response to the fact that the file is read, reading and updating information in the pre-reading structure pointer, and judging whether reading is local random reading or not; and in response to the fact that the reading is local random reading and the continuous reading frequency in the updated information is greater than 1 and the current reading position is greater than or equal to the pre-reading trigger point in the updated information, carrying out pre-reading. By using the scheme of the invention, the pre-reading performance of the local random reading scene of the large file can be improved, the pressure of small io blocks on a network disk can be avoided, and the network and disk pressure of the local random reading scene of the large file can be reduced.

Description

technical field [0001] This field relates to the computer field, and more specifically relates to a method and device for partial random read-ahead of files in a distributed file system. Background technique [0002] For a distributed file system (object storage), the IO bottleneck of large file reading is mainly in the network and disk, while memory performance far exceeds that of the network and disk. Pre-reading can shield the low performance of the network and disk and improve the overall read performance. At present, the read-ahead mechanism exists on the distributed file storage server, but it only occurs when the server receives sequential IO. At present, software parallel processing has been widely used. After the user reads sequentially and is forwarded in parallel by the protocol software, the storage server receives The IO exhibits local random read characteristics. At present, pre-reading cannot achieve the expected effect. Contents of the invention [0003] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/182
CPCG06F16/13G06F16/182G06F16/134
Inventor 王帅阳李文鹏张端
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com