Intelligent acceleration method for metadata access of distributed storage system

A distributed storage and metadata technology, which is applied in digital data processing, input/output process of data processing, instruments, etc. It can solve the problems of time-consuming metadata search and high metadata delay.

Pending Publication Date: 2021-08-31
BEIJING INST OF COMP TECH & APPL
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the continuous expansion of the data capacity in the storage system, the search for metadata becomes more and more time-consuming, especially in the storage system of a large number of small files, the search for metadata becomes one of the main reasons for the high delay

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent acceleration method for metadata access of distributed storage system
  • Intelligent acceleration method for metadata access of distributed storage system
  • Intelligent acceleration method for metadata access of distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the purpose, content, and advantages of the present invention clearer, the specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0035] The invention intelligently distributes the metadata by analyzing the relationship between the popularity of the metadata and the time and the IP of the machine head, thereby improving the query efficiency and system reliability; meanwhile, the localized access of the metadata reduces the access delay.

[0036] Such as figure 1 As shown, the present invention provides a distributed storage system metadata access intelligent acceleration method, including:

[0037] Step 1. Metadata access information statistics: the metadata server is responsible for recording the time when the metadata is accessed and the IP information of the machine head (the server that provides external services for the storage system), and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an intelligent acceleration method for metadata access of a distributed storage system, and relates to the technical field of computer storage. According to the method, by analyzing the relationship between the heat of metadata and the time and a machine head IP, the metadata is intelligently distributed, so that the query efficiency and the system reliability are improved; and meanwhile, the access delay is reduced through the localized access of the metadata.

Description

technical field [0001] The invention relates to the technical field of computer storage, in particular to an intelligent acceleration method for metadata access in a distributed storage system. Background technique [0002] With the continuous expansion of the data capacity in the storage system, the search for metadata becomes more and more time-consuming, especially in the storage system of a large number of small files, the search for metadata becomes one of the main reasons for the high delay. Metadata (Metadata) is data describing data (data about data), which records various information of data. In a distributed storage system, metadata is usually stored centrally on one or more nodes. These nodes are called metadata nodes. The existence of metadata nodes makes the distribution of data controllable, which is conducive to the online expansion of the storage system. . [0003] Usually, there are certain rules for clients to access the storage system: some data is frequ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06N20/00
CPCG06F3/061G06F3/0638G06F3/0656G06F3/067G06N20/00
Inventor 邓玲陕振宋珺
Owner BEIJING INST OF COMP TECH & APPL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products