Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A key-value separation storage method and system without garbage collection

A technology that separates storage and key values. It is applied in instruments, database indexing, computing, etc. It can solve problems such as high write amplification and performance loss, and achieve the effects of avoiding repeated rewriting, improving performance, and large available storage space.

Active Publication Date: 2021-07-30
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a key-value separation storage method and system without garbage collection. When the workload is high, it will cause high write amplification and performance loss.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A key-value separation storage method and system without garbage collection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0028] The present invention mainly relates to the operation of following three aspects:

[0029] (1) Get invalidation index

[0030] The failure index to be collected in the present invention comes from the merge operation of the key storage management module. In LevelDB, whether a piece of data should be discarded is marked with a Boolean variable drop. LevelDB only performs subsequent proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a key-value separation storage method without garbage collection, belongs to the technical field of computer storage, and solves the problem that the existing key-value separation key-value storage system cannot achieve high performance under update-intensive workload. The present invention is mainly aimed at update-intensive workloads, and realizes in-place updates through effective management of invalid data, thereby eliminating garbage collection operations in the storage process, avoiding frequent rewriting of valid data in the key-value storage system, and reducing key-value storage System write amplification. For update-intensive workloads, the present invention first uses the method of key-value separation to store data in the value storage management area, and stores the keys in the data in the LSM tree for management, and then collects, manages and reuses invalid data The index implements in-place update and overwrite recovery for invalid data, eliminates the garbage collection process, avoids the overhead caused by garbage collection, and improves the performance of the key-value storage system.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more particularly relates to a storage method and system for key-value separation without garbage collection. Background technique [0002] A key-value storage system based on a Log-Structured Merge Tree (LSM tree for short) is a storage solution for write-intensive applications, which can provide better write performance. However, the LSM tree will generate high write amplification during read and write operations. When more key-value data is written into the LSM tree, the LSM tree will perform frequent data merge operations, which will also result in a large amount of additional I / O operation; in addition, when such a write amplification reaches 50 times or more, it is unfavorable for the write performance of the key-value storage system and the durability of the solid state disk (Solid state disk, SSD for short). [0003] In order to reduce the overhead caused by the data mergin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21G06F16/215G06F16/22
CPCG06F16/215G06F16/217G06F16/221
Inventor 周可王桦刘莉林立亚
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com