Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data writing method, device, storage server, and computer readable storage medium

a data writing and data technology, applied in the field of storage technologies, can solve the problems of fixed write policy bound to be inefficient, increase the read hit rate of cache, and increase so as to improve the efficiency of write policy

Pending Publication Date: 2022-03-03
TENCENT TECH (SHENZHEN) CO LTD
View PDF2 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The patent application provides a method to improve the efficiency of writing data to a cache by separating write-only data from ordinary data. By determining the type of data to be flushed, the method reduces unnecessary traffic to the cache and improves the utilization of cache space, ultimately improving read performance. The application also provides a data writing device, storage server, and computer storage medium that support this method.

Problems solved by technology

In ever-changing and diverse cloud workloads, a fixed write policy is bound to be inefficient.
Therefore, how to raise the efficiency of write policies is a technical problem to be solved by a person skilled in the art.
Considering that write-only data is only for write operations within a certain time window and not for read operations, loading the write-only data to the cache not only will not increase a read hit rate of the cache, but will also cause a large amount of unnecessary write traffic to the cache.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data writing method, device, storage server, and computer readable storage medium
  • Data writing method, device, storage server, and computer readable storage medium
  • Data writing method, device, storage server, and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031]In typical cloud block storage products, such as Tencent CBS and Ceph (a distributed file system), when a client generates a write request, write data corresponding to the write request is first written to a write buffer, and at the same time is sequentially recorded in a log file. When the amount of dirty data in the write buffer exceeds a certain threshold, data in the write buffer will be submitted to a cache, for example, a Solid State Drive (SSD) cache. The write data in the cache will be further asynchronously flushed to a back-end hard disk drive (HDD) storage based on the write-back policy.

[0032]However, inventors of this application find that in the Input / Output (IO) logs collected by the CBS in one month, 47.09% of the data only has the write operation, that is, 47.09% of the data is write-only data. Because a read request of a user will not hit such write-only data, submitting the write-only data to the cache does not enable the user to perceive the corresponding ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

This application discloses a data writing method, device, a storage server and a computer readable storage medium, including: writing, when a write request is received, write data corresponding to the write request to a write buffer; acquiring historical access data of a data block corresponding to to-be-flushed data in the write buffer when a data flushing operation is triggered for the write buffer; determining whether the to-be-flushed data is write-only data based on the historical access data by using a pre-trained classifier; if yes, writing the to-be-flushed data to a hard disk drive; and if no, writing the to-be-flushed data to a cache. The data writing method provided by this application can effectively reduce the traffic of writing dirty data to the cache while reserving more space in the cache for the ordinary data, thereby improving the utilization of the cache space and the read hit rate of the cache.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application is a continuation application of PCT Patent Application No. PCT / CN2020 / 119881, entitled “DATA WRITING METHOD AND APPARATUS, AND STORAGE SERVER AND COMPUTER-READABLE STORAGE MEDIUM” filed on Oct. 9, 2020, which claims priority to Chinese Patent Application No. 201911304631.1, filed with the State Intellectual Property Office of the People's Republic of China on Dec. 17, 2019, and entitled “DATA WRITING METHOD, DEVICE, STORAGE SERVER, AND COMPUTER READABLE STORAGE MEDIUM”, all of which are incorporated herein by reference in their entirety.FIELD OF THE TECHNOLOGY[0002]This application relates to the field of storage technologies, and specifically, to a data writing technology.BACKGROUND OF THE DISCLOSURE[0003]When a client generates a write request, a storage server determines whether to load to-be-written data to a cache and when to flush dirty data in the cache to a back-end hard disk drive according to a write policy. Th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(United States)
IPC IPC(8): G06F3/06G06N20/00
CPCG06F3/0655G06F3/0679G06N20/00G06F3/0604G06F3/061G06F3/0644G06F3/0656G06F3/0676G06F12/0868G06F12/0888G06F2212/502G06F2212/1016G06F2212/154G06F2212/314G06F2212/217
Inventor ZHANG, YUZHOU, KEWANG, HUAHU, JIANYINGJI, YONGGUANG
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products