Data block processing method, device and equipment, and storage medium

A processing method and data block technology, applied in the computer field, can solve the problems of low indexing effect of data blocks and restrictions on the application of deduplication technology, and achieve the effect of improving indexing efficiency and promoting application

Active Publication Date: 2021-03-09
北京云宽志业网络技术有限公司
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the case of a large amount of data storage, the indexing effect on data blocks is low, which limits the application of deduplication technology in large-capacity storage systems.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data block processing method, device and equipment, and storage medium
  • Data block processing method, device and equipment, and storage medium
  • Data block processing method, device and equipment, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] In the following, only some exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present application. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.

[0080] With the continuous development of computer technology, people will generate a large amount of data in their work and life, and usually store the large amount of data in a storage system. However, there may be redundant data in the storage system, therefore, it is necessary to deduplicate the duplicate data, that is, to delete the duplicate data.

[0081] For example, the concept of "regulation compliance" is involved in the Write Once Read Many (Write Once Read Many, WORM) technology. For example, in some countries, new government regulations coupled with growing data storage requirements have ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data block processing method, device and equipment, and a storage medium. A target storage unit corresponding to a target logic address is determined through the target logicaddress of a to-be-processed target data block, the target storage unit comprises bitmap information, and the bitmap information is used for representing whether a data block corresponding to each logic address in a plurality of logic addresses corresponding to the target storage unit is a repeated data block or not. Furthermore, a target physical address corresponding to the target logic addressis determined according to a flag bit corresponding to the target logic address in the bitmap information, the flag bit is used for representing whether the target data block is a repeated data blockor not, and the target data block is processed according to the target physical address. Under the condition of storing a large amount of data, the indexing efficiency of the target data block can beeffectively improved, so that the application of a deduplication technology in a large-capacity storage system is promoted.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a data block method, device, equipment and storage medium. Background technique [0002] With the continuous development of computer technology, people will generate a large amount of data in their work and life, and usually store the large amount of data in a storage system. However, there may be redundant data in the storage system, therefore, it is necessary to deduplicate the duplicate data, that is, to delete the duplicate data. [0003] The data deduplication process in the related art usually divides a data file into multiple data blocks. Further calculating the fingerprint information of each data block in the plurality of data blocks, and using the fingerprint information of each data block as a key of each data block to perform a hash search, thereby determining whether the data block is a duplicate data block. [0004] However, in the case of massive ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F12/06
CPCG06F3/0608G06F3/0641G06F12/06
Inventor 高华龙
Owner 北京云宽志业网络技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap