File reading method, system and related device of distributed storage system

A distributed storage and system file technology, applied in the computer field, can solve the problems of reducing the read and write performance of the storage system, increasing the number of disk IOs, etc., and achieve the effect of improving sequential reading performance, reducing the number of IOs, and improving performance

Active Publication Date: 2019-03-29
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF10 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the upper limit of IO (Input / Output) reading and writing by the client through the iscsi protocol is 512k, if the IO size of the client accessing the storage system is 1M or larger, the client's IO request will be split into multiple 512k requests, In this way, the client needs to interact with the OSD (full name in Chinese: Object Storage Devices, full name in English: Object Storage Devices) in the storage system multiple times, which increases the number of disk IOs and reduces the read and write performance of the entire storage system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File reading method, system and related device of distributed storage system
  • File reading method, system and related device of distributed storage system
  • File reading method, system and related device of distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0043] The embodiment of the present application discloses a file reading method of a distributed storage system, which improves the reading and writing performance of the storage system.

[0044] see figure 1 , a flow chart of a method for reading files in a distributed storage system according to an exemplary embodiment, as shown in figure 1 shown, including:

[0045] S101: When receiving the IO request from the client, determine the pre-read upper limit according to the data size of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a file reading method and system of distributed storage syste, an electronic device and a computer-readable storage medium. That method comprise the steps of: when an IO request of a client is received, determining a read-ahead upper limit accord to a data size of the IO request; Sending a read request with a size of the upper limit of the pre-read to the object storage device each time, and storing a return result of the read request into a memory until all data corresponding to the IO request are read; Returning data corresponding to the IO request stored in the memory to the client. Thus, the file reading method provided by the application can reduce the interaction times between the client and the object storage device, reduce the IO times of the disk, improve the sequential reading performance, thereby improving the performance of the entire storage system and enhancing the product competitiveness.

Description

technical field [0001] The present application relates to the field of computer technology, and more specifically, to a distributed storage system file reading method and system, an electronic device, and a computer-readable storage medium. Background technique [0002] As distributed block storage systems are widely used in various fields, customers have higher and higher performance requirements for storage systems, and it is increasingly important to improve the performance of distributed block storage systems. The distributed block storage system utilizes the high bandwidth and high IOPS (Input / Output Operations Per Second, one for computer storage devices) aggregation capabilities of IP (full name in Chinese: Internet Protocol, full name in English: Internet Protocol) network. It provides a unified block data access service externally, and at the same time, the client accesses the distributed block storage system through the ISCSI (Internet Small Computer System Interfa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0643G06F3/0659G06F3/067
Inventor 李军站
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products