Distributed storage write buffer data step-by-step brushing method and device and medium

Abstract

The invention relates to a distributed storage write buffer data step-by-step brushing method and device and a medium. The method comprises the following steps: deeply copying object metadata of to-be-refreshed data to generate temporary object metadata, and processing a writing process of the to-be-refreshed data by utilizing the temporary object metadata to obtain disk space information of a disk space for storing the to-be-refreshed data so as to form disk write-in preparation information; then writing the to-be-refreshed data into a slow disk according to disk write-in preparation information, and in the process, compared with a conventional means, not updating the object metadata, but only writing the to-be-refreshed data; after writing is completed, the object metadata is used for processing the writing process of the data to be brushed down again, and updating of the object metadata is completed. According to the method and the device, asynchronization of data writing and object metadata updating in the down-brushing process of the to-be-down-brushed data is realized, priority of service writing is ensured, the data down-brushing efficiency is improved, the object metadata does not need to be recorded and updated, the program complexity is reduced, and maintenance is convenient.

Description

technical field [0001] The present application relates to the technical field of buffer flushing, and in particular to a method, device and medium for stepwise flushing of distributed storage write buffer data. Background technique [0002] In distributed storage, high-speed devices are usually used as write buffers to improve the write performance of the system. High-speed devices have strong read and write performance and can read and write quickly, but their capacity is limited. Data written to high-speed devices needs to be flushed to slow devices. After that, the downloaded data can be released from the high-speed device, so that the high-speed device can continuously accept write requests, thereby improving system performance. [0003] The flushing process of buffered data on high-speed devices involves the transfer of the buffered data itself and the update of the corresponding object metadata. The buffered data needs to be read from the high-speed device and written ...

AI Technical Summary

Problems solved by technology

In the implementation of brushing down by stages and steps, one implementation method is to identify the data information to be written, record the update information of the object metadata, execute the data writing, and finally update the recorded object metadata update information to Object metadata and persistence, this processing method is not intuitive enough, and in addition to the original business writing process, a set of downsizing logic is implemented. When the business writes object metadata changes, the downsizing process also needs to Make corresponding adjustments, especially when the object metadata structure information is complex, the update information record and update process of the object metadata will be more complicated, this implementation method is not conducive to software maintenance

Images