Partition segmentation method and device, server and storage medium

Abstract

An embodiment of the invention relates to the field of Internet technology application, and discloses a partition segmentation method and device, a server and a storage medium. The method comprises the steps: acquiring a first critical point set, wherein the row key prefix of a row identified by a critical point is different from the previous row key prefix of the row identified by the critical point; obtaining the distance between the row of the critical point identifier and the partition center; obtaining a second critical point set of which the distance meets a preset distance range from the first critical point set; selecting a segmentation point according to the second critical point set. According to the method and the device, region fragments caused by non-uniform segmentation can be reduced, empty partitions caused by continuous splitting are reduced, meanwhile, the balanced load of the data on the partition level is kept as much as possible, and the region management of the cluster is facilitated.

Description

technical field [0001] The embodiments of the present invention relate to the field of Internet technology applications, and in particular, to a method, device, server, and storage medium for partitioning and dividing. Background technique [0002] Hbase is a distributed, column-oriented open source database. The scalability of the HBase cluster is mainly realized by partitions. The partition automatic segmentation mechanism ensures the scalability of the HBase table in the cluster. The theory of partition segmentation involves the triggering of segmentation. Timing, determination of segmentation point, transactional guarantee and exception handling of segmentation, and optimal selection of segmentation. Currently, HBase provides a variety of optional partition segmentation strategies, which determine the selection of segmentation thresholds and segmentation points. [0003] However, the inventors found the following problems in related technologies: Since Hbase row keys ar...

AI Technical Summary

Problems solved by technology

[0003] However, the inventors found the following problems in related technologies: Since Hbase row keys are arranged in lexicographical order, the prefix segmentation strategy of related technologies will cause uneven segmentation and thus partition fragmentation. The extreme situation of partition (region) is greatly detrimental to the region management and performance load of the cluster

Images