Data writing method and apparatus in distributed system

A distributed system and data writing technology, applied in the input/output process of data processing, electrical digital data processing, input/output to record carrier, etc., can solve the problem of high delay and burr rate of write operation, and achieve both performance and stability, suppression of negative effects, and reduction of burr rate

Active Publication Date: 2017-12-19
ALIBABA GRP HLDG LTD
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, there is a problem of high delay glitch rate of write operation in the existing distributed storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data writing method and apparatus in distributed system
  • Data writing method and apparatus in distributed system
  • Data writing method and apparatus in distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] Embodiment 1. A data writing method in a distributed system, such as figure 2 As shown, including steps S110-S120:

[0067] S110. After receiving the user's write request for the first file, sequentially initiate a write data request for multiple writable blocks of the first file according to the first time interval; the first time interval is based on the performance of the write operation The indicators are determined dynamically, and a write operation includes multiple write data requests initiated for a write request;

[0068] S120. Stop initiating a data write request after detecting that any data write request among successively initiated data write requests succeeds.

[0069] In this embodiment, the first time interval is equivalent to a write request for the first file by the user. When sequentially initiating write data requests, the time interval between two adjacent write data requests can also be regarded as redundant The sending interval of write data re...

other Embodiment approach

[0111] In other implementation manners, the dynamic determination of the first time interval may also be implemented in other ways, such as using the time delay of the write operation and the sending redundancy within a predetermined length of time before the moment of the first time interval to be determined The first time interval is calculated by the cumulative value of the number of times of remaining write data requests; another example is based on the number of times redundant write data requests are sent within a predetermined length of time before the moment of the first time interval to be determined and the number of write operations The number of times, the average number of redundant write data requests sent for each write operation is obtained, and then used together with the average value of the delay to calculate the first time interval.

[0112] In this embodiment, the first time interval is based on L avg And the Qps calculation can include:

[0113] The firs...

Embodiment 2

[0163] Embodiment 2. A data writing device in a distributed system, such as image 3 shown, including:

[0164] The initiating module 21 is configured to, after receiving the user's write request for the first file, sequentially initiate a write data request for a plurality of writable blocks of the first file according to a first time interval; the first time interval is based on The performance index of the write operation is dynamically determined, and a write operation includes multiple write data requests initiated for a write request;

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a data writing method and apparatus in a distributed system. The data writing method comprises: after receiving a write request from a user for a first file, according to a first time interval, sequentially initiating write data requests to a plurality of writable blocks of the first file, wherein the first time interval is dynamically determined according to the performance indexes of write operations, and one write operation comprises a plurality of write data requests initiated for one write request; and when it is detected that any write data request in the sequentially initiated write data requests is successful, stopping initiating the write data request. According to the method and apparatus disclosed by the present application, the write delay glitch rate can be reduced, and the sending interval of the redundant write data request can be adaptively adjusted.

Description

technical field [0001] The invention relates to the field of distributed storage, in particular to a data writing method and device in a distributed system. Background technique [0002] Cloud computing technology is becoming more and more popular now, and distributed storage is one of the most basic problems to be solved by cloud computing. The distributed storage system stores data on multiple physically dispersed storage nodes, manages and allocates the resources of these nodes in a unified manner, and provides users with a file access interface, which solves the problems of the local storage system in file size, file quantity, open Limitations on the number of files, etc. [0003] Today's typical distributed storage systems are deployed in a three-terminal mode, usually including a master server, storage nodes, and clients. The master control server is also called metadata server, name server, namespace management module, and management server, etc., and redundant work...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0638G06F3/067
Inventor 刘善阳张海勇石超
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap