Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hash tree caching method and device

A hash tree and cache technology, applied in the field of hash tree cache methods and devices, can solve problems such as affecting distributed storage write performance, and achieve the effects of improving write performance and complexity.

Pending Publication Date: 2021-01-29
西安奥卡云数据科技有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These two reciprocal operations require that only one operation can be performed at the same time, which greatly affects the write performance of distributed storage.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hash tree caching method and device
  • Hash tree caching method and device
  • Hash tree caching method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0040] In the existing hash tree operations, various modification operations on the hash tree cannot be reconciled, and only one of the operations can be run at the same time, and mutually exclusive access is ensured through the lock mechanism. At the same time, in order to reduce the design complexity of the software, a giant lock is adopted, so that when the hash tree is persistent, the read and write tasks cannot access the hash tree to obtain the mapping relationship, blocking the user's read and write requests. Generally speaking, in addition to being unable to support reasonable storage read and write performance, the existing technical solutions also have obvious performance fluctuations.

[0041] In the present invention, a pair of front buffers are skillfully arranged in the memory. The change of the hash tree mapping relationship t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a hash tree caching method and device, and the method comprises the steps: determining the position information of written data in a hash tree according to the logic position of the written data, and storing a hash signature and the position information of the written data in a first front buffer region; when the first preposed buffer area is full, taking the first preposedbuffer area as a current standby preposed buffer area, and updating internal data of the first preposed buffer area to the hash tree; when the space size of the hash tree reaches a threshold value, persisting the hash tree to a disk. According to the method, the first front buffer area and the second front buffer area are introduced, so that the read-write data corresponds to the front buffer areas, the two inverse hash tree operations are effectively isolated, the complexity of the hash tree operations is improved, persistent concurrent execution of the user read-write task and the hash treecan be realized, and the user experience is improved. And the determination writing performance of the distributed storage system is effectively improved.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and in particular relates to a hash tree caching method and device. Background technique [0002] The basic method of distributed storage space management is to map the user-visible logical volume device to the underlying data blocks distributed on the disks of each node through various mappings. In order to maintain this mapping relationship, the system needs to manage a large amount of metadata. [0003] In all mapping relationships, the logical volume device usually uses a tree to realize mapping from a continuous virtual address space to a discontinuous physical storage space. Existing storage solutions use hash signature-based methods to construct spatial trees, which are generally called hash trees. Generate a hash signature based on the content, and use the hash signature to construct the spatial tree of the logical volume. The advantage of this scheme is that the data can be v...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/172G06F16/17G06F16/182
CPCG06F16/137G06F16/172G06F16/1727G06F16/182
Inventor 于超
Owner 西安奥卡云数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products