Method, device and system for data management

Abstract

Embodiments of the present invention provide a data management method, device and system. Know the data partition where the cold data segment is located in the first storage device; find or separate the special data partition in the data partition where the cold data segment is located, and all the data segments contained in the special data partition are cold data segments; the special data partition from The first storage device is migrated to the second storage device, and the data processing capability of the first storage device is stronger than that of the second storage device; the special data partition is set to an offline mode, so that cold data segments in the special data partition are not accessed. In the present invention, by setting the partition where the cold data segment is located as an offline mode, without the need for external storage media, without manual transfer of the cold data segment, and without complicated operation procedures, it can achieve that the cold data will not be damaged when accessing the hot data within the plan. The purpose of accidental access to fragments, thereby avoiding the extension of query response time and the degradation of query performance caused by it.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a data management method, device and system. Background technique [0002] With the popularity of mobile terminals, cloud computing and the Internet of Things, and the follow-up of industry regulatory requirements, we are entering an era of rapid data expansion. How to design a more cost-effective storage and access strategy for a large amount of inflated data is a hot research topic in the field of storage and data. According to the degree of hotness and coldness of the data, it can be simply divided into hot data and cold data. In fact, frequently accessed hot data tends to account for a relatively small proportion, generally 10%-15%, and most of the remaining data is cold data. For these cold data, there is not much demand for computing power, and generally it only needs to be well stored and managed. In reality, data models that are generated in chronologica...

AI Technical Summary

Problems solved by technology

The query range is wrong and cold data is accidentally accessed, the query speed will slow down or the query result will be wrong. If the user finds out, he can withdraw and re-enter the search midway, but this has already wasted time, and realizes that the probability of problems in his search is not very high. The user withdraws and re-enters the operation midway, and it may reach the level of ten seconds or even tens of seconds from input to response

[0014] In the existing technology, on the premise of ensuring the reduction of cold data overhead, in order to prevent accidental access to cold data when querying hot data, the cold data can be removed from the local cold data storage device through regular manual operations and backed up to an external cold data storage device , however, backups and future re-reading require reconnection to external cold data storage devices, and data needs to be moved and moved regularly. The entire operation process is complicated, and the read and write operations consume a long time

Images