A Storage System Based on Distributed Cluster

A distributed cluster and storage system technology, applied in the field of distributed cluster-based storage systems, can solve the problems of high pressure to write data to the disk, low disk space usage, and long time-consuming analysis of metadata to read data, etc.

Active Publication Date: 2020-07-07
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Each small file storage will perform a full write process, resulting in high pressure to write data on the disk, low disk space usage, and time-consuming analysis of metadata and reading data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Storage System Based on Distributed Cluster
  • A Storage System Based on Distributed Cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions protected by the present invention will be clearly and completely described below using specific embodiments and accompanying drawings. Obviously, the implementation described below Examples are only some embodiments of the present invention, but not all embodiments. Based on the embodiments in this patent, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this patent.

[0023] The present invention provides a storage system based on distributed clusters, such as figure 1 shown, including:

[0024] Client 1, cache module 4, file size judging module, cache size judging module, storage processing module, cache processing module, common storage module 2 for storing common data files, and aggregation storage module 3 for storing aggregated files;

[0025] Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a storage system based on a distributed cluster. A file size judgment module is used for judging the size of a client in-file, and when the size of the file is less than a firstpreset value, a storage processing module is used for storing the file to a caching module; the file size judgment module is further used for judging the size of a client reading file, when the sizeof the file is less than that of the first preset value, the storage processing module is used for feeding the judgment result of the file size judgment module back to a client, and the client is usedfor reading the file through the caching module; the catching size judgment module is used for judging the size of an aggregation file stored by the storage processing module, when the size of the aggregation file reaches a second preset value, a caching and processing module is used for writing the aggregation file, which is in the caching module, into an aggregation storage module. The storagesystem can be used for effectively reducing the times of writing a small file in a disk and improving reading hit rate.

Description

technical field [0001] The invention relates to the field of computers, in particular to a storage system based on distributed clusters. Background technique [0002] With the development of the times, a large number of data files are generated. The computer manages and stores data through the file system, and simply increases the number of hard disks to expand the storage capacity of the computer file system. In terms of capacity size, capacity growth rate, data backup, data Safety and other aspects of the performance are unsatisfactory. The distributed file system can effectively solve the problem of data storage and management. A file system fixed at a certain location can be extended to any number of locations or multiple file systems. Many nodes form a file system network. Each node can be distributed in different locations, and the communication and data transmission between nodes can be carried out through the network to establish a huge cluster system. When people ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0617G06F3/0638G06F3/067
Inventor 陈保平
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap