Generation method of pre-join table on ring-shaped schema database

Abstract

The invention discloses a generation method of a pre-join table on a ring-shaped schema database, belonging to the field of distributed data storage. The method comprises the following steps of: establishing a Key-Value database, forming a column value index of a key column and storing the column value index in the database; generating a pre-join table; if an original data table is updated, updating the corresponding pre-join table; and executing data query, and outputting query result. With the pre-join table generation method provided by the invention, the pre-join table can be efficiently generated in the ring-shaped schema Key-Value database, and a quick join query function is provided; by optimizing a computational process, time and space cost for generating the pre-join table is reduced, and calculation speed is accelerated; and simultaneously, query delay is reduced according to an updating and maintaining method, and real-time join query result can be provided.

Description

technical field [0001] The invention belongs to the field of distributed data storage, and mainly relates to a method for generating a pre-connection table on a ring-structured database. Background technique [0002] Document-oriented Key-Value databases like MongoDB store documents with structural and semantic information like XML and JSON, so at the cost of consuming more memory and disk space, the value An index has been established on the database, and through index retrieval, it can better support conditional queries on a single table. Even so, document-oriented databases like MongoDB do not support complex multi-table join queries. [0003] For another common Key-Value database: Hbase, its data is stored on the distributed file system Hadoop, and its SQL query function is actually implemented with the help of Hadoop-based Hive, which is built on Hadoop It is a tool that can extract, transform and load data. Most of its query functions are completed by MapReduce, which...

AI Technical Summary

Problems solved by technology

[0003] For another common Key-Value database: Hbase, its data is stored on the distributed file system Hadoop, and its SQL query function is actually implemented with the help of Hadoop-based Hive, which is built on Hadoop It is a tool that can extract, transform and load data. Most of its query functions are completed by MapReduce, which leads to the following two shortcomings: First, because Hive itself is designed for data warehouse applications that read more and write less. Therefore, Hive does not support rewriting and adding data. If the data stored in the database is frequently updated, Hbase cannot support it. In addition, due to the high delay of MapReduce itself, the SQL query delay of Hbase is relatively slow. high

[0004] The currently popular ring-architecture Key-Value database: Cassandra, can support conditional queries on a single table by establishing a column value index for a specified column, but currently does not support multi-table join queries

Images