Data compression method and device and computer readable storage medium

Abstract

The invention discloses a data compression method and device and a computer readable storage medium. The method comprises the steps of receiving a write request issued by a host, judging a numerical relationship between an occupied space capacity value of the to-be-processed data corresponding to the write request and a preset minimum decision sampling threshold value; if the occupied space capacity value of the to-be-processed data is not greater than the preset minimum decision sampling threshold value, or if the occupied space capacity value of the to-be-processed data is greater than the preset minimum decision sampling threshold value and the compression rate of the to-be-processed data is less than the preset maximum compression rate threshold value, compressing the to-be-processed data, and meanwhile, identifying the field corresponding to the metadata of the to-be-processed data as compressed data; and if the compression rate of the to-be-processed data is not less than the preset maximum compression rate threshold, not compressing the to-be-processed data, and marking the field corresponding to the metadata of the to-be-processed data as original data. Data reduction can be more efficiently achieved through data compression, the data processing efficiency of the storage system is improved, and the storage performance of the storage system is improved.

Description

technical field [0001] The present application relates to the field of storage technology, in particular to a data compression method, device and computer-readable storage medium. Background technique [0002] With the rapid development of information industrialization, the growth rate of information data is obvious, and the scale of data that needs to be stored is getting larger and larger. Users have put forward higher requirements for the capacity of storage devices. The capacity of storage devices is directly proportional to the cost within a certain range. , the corresponding price of a storage device with a larger capacity is higher, and the increase in production cost is obviously unfriendly to users. Data reduction has become a widely used technology to improve the storage performance of storage devices. Data compression is the key to data reduction. One implementation manner, but since compression needs to consume more system resources and time, how to improve data ...

AI Technical Summary

Problems solved by technology

When encountering data with a high compression rate, data compression does not bring obvious data reduction effect, but increases time delay and reduces storage processing efficiency

Images