Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

HBase region merging method and device, computer-readable storage medium

A computer and name technology, applied in the field of data processing, can solve the problem that the empty data area Region is too small, affecting the operation efficiency of HBase, etc., and achieve the effect of reducing the locking time

Inactive Publication Date: 2020-08-14
上海帝联网络科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using HBase to store data in a large area, due to multi-team collaboration and the use of HBase by each team in different ways, problems such as empty data regions (Regions) or too small regions will affect the operating efficiency of HBase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HBase region merging method and device, computer-readable storage medium
  • HBase region merging method and device, computer-readable storage medium
  • HBase region merging method and device, computer-readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] HBase can easily expand column families and columns, and naturally supports massive data retrieval. However, when HBase is actually used to store data in a large area, due to multi-team collaboration, each team uses HBase in different ways. There may be problems such as setting the size of the Region too small, and pre-allocating the Region data in a certain table. Errors and other reasons lead to problems such as empty Regions or too small Regions on the line, affecting the operating efficiency of HBase and causing system crashes in severe cases. In order to solve the above problems, in the prior art, the HBase administrator can regularly maintain the online Regions to ensure the stable and efficient operation of HBase.

[0032] The maintenance of the Region may include merging adjacent Regions to improve the operating efficiency of HBase. In the prior art, when merging adjacent Regions, the org.apache.hadoop.hbase.util.merge method is usually used to stop the cluster...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a region merging method and device of HBase and a readable storage medium of a computer. The method comprises the following steps: obtaining all Region information of clusters; obtaining each piece of Region information of a pre-configured Region list according to all the Region information of clusters; selecting a Region from the Region list according to each Region information of the Region list, wherein the Region and an adjacent Region meet a merging condition; obtaining encrypted Region name lists corresponding to all selected Regions; and merging adjacent two Regions in the encrypted Region name list with a merge_region command. In the above technical scheme, Region merging operation can be performed while clusters operate.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a HBase Region merging method and device, and a computer-readable storage medium. Background technique [0002] HBase is a distributed, column-oriented open source database. HBase technology comes from the Google paper "bigtable: a distributed storage system for structured data" written by Fay Chang. HBase provides capabilities similar to Bigtable on top of the Hadoop Distributed File System (The Hadoop Distributed File System, HDFS). HBase is the most common database for Hadoop clusters, suitable for storage of unstructured and massive data. [0003] With the continuous expansion of the user scale, it is necessary to store multi-dimensional statistical data of a large number of users. When using HBase to store data in a large area, due to multi-team collaboration, and each team uses HBase in different ways, problems such as empty data regions (Region) or too small Regions will ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/27
CPCG06F16/22G06F16/27
Inventor 黄凯旋康凯
Owner 上海帝联网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com