Data recovery task control method and device, electronic equipment and storage medium

Abstract

The invention discloses a data recovery task control method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a first data recovery task being executed in a storage system in a current detection period, and determining a first task amount corresponding to the first data recovery task; querying the storage amount of the storage system in the current detection period, and determining a task amount threshold value corresponding to the storage amount; when the first task load is lower than a task load threshold value, determining a newly added second task load according to a difference value between the task load threshold value and the first task load; and obtaining a target token number meeting the second task load from the token bucket, and distributing the tokens of the target token number to a second data recovery task corresponding to the second task load. When the executed task amount is lower than the task amount threshold value corresponding to the current storage amount, the data recovery speed is increased by increasing the task amount, meanwhile, the number of the tokens in the token bucket is dynamically set according to the service pressure level, and balance between service processing and data recovery can be achieved.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a control method, device, electronic equipment and storage medium for a data recovery task. Background technique [0002] The distributed storage system adopts a redirection write algorithm, and every time a piece of data is written, it will be written to a different storage unit through redirection to improve the performance of data writing. But even if it is the same piece of data, if it is modified, deleted, and newly written multiple times, the specific location on the disk will be different each time. Therefore, in the same storage system, there will be multiple copies, Invalid data takes up storage space. Then, after running for a long time, a storage system will soon be full, and most of the stored data are repetitive and invalid data, resulting in low utilization of storage space and a short life cycle of the storage system. [0003] In the prior art, in...

AI Technical Summary

Problems solved by technology

[0004] In the process of realizing the present invention, the inventor found that the recovery of garbage data needs to occupy the bandwidth and traffic of the OSD. When there is a lot of garbage to be recovered, a large number of internal read, write and delete operations will seize the bandwidth and traffic of normal business, thus Affect the efficiency of equipment processing business

Images