A data segment migration method and system

A technology for migrating systems and data segments, which is applied in the field of data migration systems and data migrations. It can solve the problems of not being able to take into account the size of data segments, hot data identification accuracy and data classification management at the same time, so as to reduce the amount of metadata and manage performance. The effect of reducing the amount of data migration

Active Publication Date: 2019-03-15
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the tiered storage method in the prior art cannot take into account both the size of the data segment, the accuracy of identifying hotspot data, and the overhead of data tiered management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data segment migration method and system
  • A data segment migration method and system
  • A data segment migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0050] see figure 1 , figure 1 It is a schematic diagram of a data migration method provided by an embodiment of the present invention.

[0051] In a specific implementation manner, a data segment migration method is provided, including:

[0052] Step S1: Calculate the size of the data segment in each level according to the total storage space, metadata storage space and data access heat statistics of each level;

[0053] The size of the data segments at ea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data segment migration method. The data segment migration method includes the steps that the size of data segments at each level is calculated according to the total storage space and metadata storage space of each level and data access heat statistical information; at least one target data segment is selected from the target level, and whether it is needed to trigger the target data segment to migrate toward the upper level or the lower level is judged; if the target data segment is triggered to migrate to the upper level, the target data segment is split according to the size of the data segments in the upper level, and a copy of the target data segment is reserved in the target level; if the target data segment is triggered to migrate to the lower level, the target data segment and a parent data segment in the lower level are combined, and the target data segment is deleted from the target level. The recognition precision to hotspot data by the size of the data segments is improved, metadata quantity with data classification function and management performance expenditure can be effectively reduced. The invention further discloses a data segment migration system.

Description

technical field [0001] The present invention relates to the technical field of data storage, and more specifically, to a data migration method and a data migration system. Background technique [0002] With the rapid growth of Internet data volume, people put forward higher and higher requirements for the capacity and performance of storage systems. Modern storage systems not only need large capacity, but also meet high throughput, high IOPS and low latency of IO access. However, the performance of the current storage system is still limited by the traditional mechanical hard disk (HardDisk Driver, HDD) which is the most used storage medium in the storage system. Due to its inherent physical characteristics, the random access performance of the traditional mechanical hard disk is poor. Solid Storage Driver (SSD for short) that has appeared in recent years, such as Flash memory, solid-state disk and PCM, just makes up for the shortcomings of traditional HDD's poor random acce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0647G06F3/067
Inventor 马春
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products