Data redistribution method, electronic equipment and storage medium

Abstract

The embodiment of the invention relates to the field of communication, and discloses a data redistribution method, electronic equipment and a storage medium. The method comprises the following steps: adding a bucket number identifier for a to-be-stored data record, and storing the data record to a fragmentation database corresponding to the bucket number identifier of the data record according to a preset corresponding relationship between the bucket number identifier and the fragmentation database; in response to the data redistribution request, obtaining a target bucket number identifier of to-be-migrated data; and migrating the to-be-migrated data to the target fragmented database according to the target bucket number identifier, and logically performing partition storage on the data, so that the expansibility of redistribution of a large amount of data is improved, the hot spot problem caused by overlarge data volume due to limitation of a physical partition is avoided. The system reliability is improved. The data migration is carried out by taking the data record corresponding to the bucket number identifier as the basic unit, so that the performance and the quality of the data migration are ensured, the influence on services is reduced, and the availability of data redistribution is improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of distributed data storage, and in particular to a data redistribution method, electronic equipment, and a storage medium. Background technique [0002] With the development and progress of communication technology, the current method of storing data is no longer limited to centralized storage. For the storage of big data, the data has begun to be split and stored in a distributed manner. In a distributed database, The data is stored on different data nodes according to the distribution key, forming a logically large database, and improving the comprehensive utilization of storage resources for data storage capabilities. The data volume of data nodes far exceeds that of other data nodes, which becomes the bottleneck of performance and storage capacity, seriously affecting the services of distributed databases. Data redistribution of current data is an important basic function of distributed dat...

AI Technical Summary

Problems solved by technology

[0003] The inventor found that there are at least the following problems in related technologies: offline redistribution cannot meet the requirements of business operations, and the existing methods for online redistribution of counts not only have low indexing efficiency, but also It will reduce system reliability; when redistribution of a large amount of data, the scalability is poor, and hotspot problems will still occur, and during the data migration process, data migration may fail due to disk capacity

Images