Self-adaptive flow limiting method and device for data writing rate, equipment and medium

A technology of data writing and current limiting method, which is applied in the input/output process of data processing, electrical digital data processing, input/output to record carrier, etc., can solve the problem of unsatisfactory limiting effect, improve convenience and Timeliness, improving adaptability and convenience, and avoiding fluctuations

Pending Publication Date: 2021-10-26
济南浪潮数据技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems existing in the prior art, the present invention innovatively proposes an adaptive current limiting method, device, equipment and medium for data writing rate, which effectively solves the problem that the limiting effect is not ideal due to the limitation of the existing data writing rate problem, effectively improving the reliability of data write rate limit

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive flow limiting method and device for data writing rate, equipment and medium
  • Self-adaptive flow limiting method and device for data writing rate, equipment and medium
  • Self-adaptive flow limiting method and device for data writing rate, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] Such as figure 1 As shown, the present invention provides an adaptive current limiting method of data writing rate, which is applied in a distributed storage system, including:

[0052] S1, performing data writing control on multiple IO instances;

[0053] S2, obtaining the data writing request to be written in each IO instance, and analyzing and obtaining the amount of data to be written contained in the data writing request;

[0054] S3, according to the amount of data to be written, judge the amount of data that can be written in the current first cycle for comparison, and judge whether the amount of data that can be written in the current first cycle is not less than the amount of data to be written, if the judgment result is If yes, execute step S4; if the judgment result is no, execute step S5;

[0055] S4, controlling the writing of data to be written, and updating the amount of data that can be written in the current first cycle;

[0056] S5, put the data wri...

Embodiment 2

[0096] Such as Figure 5 As shown, the technical solution of the present invention also provides an adaptive current limiting device for data writing rate, which is applied to a distributed storage system, including:

[0097] The control module 101 performs data writing control on multiple IO instances;

[0098] Obtaining the parsing module 102, obtaining the data writing request to be written in each IO instance, and analyzing and obtaining the amount of data to be written contained in the data writing request;

[0099] Comparing module 103 judges the amount of data that can be written in the current first cycle according to the amount of data to be written for comparison, if the amount of data that can be written in the current first cycle is not less than the amount of data to be written, control the amount of data to be written Write the incoming data, and update the amount of data that can be written in the current first cycle; if the amount of data that can be written i...

Embodiment 3

[0133] Such as Figure 7 As shown, the technical solution of the present invention also provides an electronic device, including: a memory 201 for storing a computer program; a processor 202 for implementing the data writing rate as described in Embodiment 1 when executing the computer program The steps of the adaptive current limiting method.

[0134] The memory 201 in the embodiment of the present application is used to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program used to operate on an electronic device. It can be understood that the memory 201 may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. Wherein, non-volatile memory can be read-only memory (ROM, Read Only Memory), programmable read-only memory (PROM, Programmable Read-Only Memory), erasable programmable read-only memory (EPROM, ErasableProgrammable Read-Only Memory) Mem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a self-adaptive flow limiting method for a data writing rate, which is applied to a distributed storage system and comprises the following steps: performing data writing control on a plurality of IO instances; obtaining a to-be-written data writing request in each IO instance; according to the to-be-written data volume, judging and comparing the data volume which can be written in the current first period, if the data volume which can be written in the current first period is not smaller than the to-be-written data volume, controlling the to-be-written data to be written in, and updating the data volume which can be written in the current first period; and if yes, carrying out data writing rate self-adaptive adjustment according to the number of the first periods waiting for the data writing request in the second period, and setting the writable data volume in the current first period according to the adjusted data writing rate. The invention further provides a self-adaptive flow limiting device and equipment for the data writing rate and a medium, and the reliability of limiting the data writing rate is effectively improved.

Description

technical field [0001] The present invention relates to the field of distributed storage systems, in particular to an adaptive current limiting method, device, equipment and medium for data writing rate. Background technique [0002] In the field of distributed storage, under special circumstances, we need to consider controlling the write rate of internal data operations in the system, such as cache flushing, log merging, etc. , due to the performance bottleneck of the hard disk, it will increase the data reading delay, affect the reading performance, and then affect the front-end business. Some data writing operations inside the distributed storage system will compete with user services if rate control is not performed, affecting front-end user services. [0003] The current rate limiting method, one is to limit the number of requests per unit time through a counter, but this method is not easy to determine whether the IO (Input / Output, input / output) operation size of a s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0629G06F3/067
Inventor 张洪鑫孟祥瑞
Owner 济南浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products