Data read-write method and device, electronic equipment and storage medium

Abstract

The invention discloses a data reading and writing method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining a data writing request,and obtaining to-be-written data corresponding to the data writing request; compressing the to-be-written data to generate compressed data; writing the compressed data into a data block of a hard disk, and determining metadata information representing the writing position of the compressed data; and writing the metadata information into a storage-level memory, wherein the metadata information isupdated in an overwriting manner. Known from above, according to the invention, metadata and user data are separately stored; to-be-written user data is compressed and then written into a hard disk; the metadata information is written into the storage-level memory, the metadata is not compressed any more, an overwriting mode is adopted when the metadata is updated, the access performance of the metadata is improved, meanwhile, performance reduction caused by high-frequency garbage collection is relieved, and the performance of a real-time compression storage system is effectively improved.

Description

technical field [0001] The present application relates to the field of computer technology, and more specifically, to a method and device for reading and writing data, an electronic device, and a computer-readable storage medium. Background technique [0002] At present, the emergence and wide application of big data have brought great challenges to the growth of storage capacity. There are two ways to deal with the growth of storage capacity. One is to expand storage capacity, but this will increase costs; the other is to compress data to reduce storage capacity consumption and save costs. The real-time compression storage system compresses the data before it is written into the storage device, which not only reduces the storage space occupation, but also further reduces the access to the storage device (disk or solid state disk), thereby improving the performance of the storage system. [0003] The traditional real-time compression storage system writes the compressed dat...

AI Technical Summary

Problems solved by technology

Since the access frequency of metadata is much higher than that of user data, its frequent updates will generate a large amount of invalid data, which increases the frequency of garbage collection and often becomes the performance bottleneck of the storage system.

Images