Time series database system based on column storage

Abstract

The invention discloses a time sequence database system based on column storage. The time sequence database system comprises: an SQL (Structured Query Language) parser, wherein the SQL parser is usedfor converting SQL into an abstract syntax tree through parsing; a logic plan generator which is used for generating a logic query plan by utilizing the abstract syntax tree, wherein the logic query plan is expressed by a relation algebra; a query optimizer which is used for optimizing the query plan by utilizing the state information of the database and outputting the rewritten query plan; an executor which is used for executing the query plan in a block iteration mode and is responsible for interacting with the storage layer to obtain data queried by a user; and a storage engine which is used for storing data in a row and column manner. According to the invention, data in the database is stored in a column mode; based on combination of column storage and rocksdb, high-speed insertion data characteristics and an indexing function of a traditional database are achieved, in the aspect of an executor, part of operators are improved to be deeply combined with characteristics of a storageengine, and meanwhile, new characteristics of a modern processor are used for accelerating query.

Description

technical field [0001] The invention belongs to the field of data storage and processing, and in particular relates to the design of a time series database system based on columnar storage. Background technique [0002] At present, there are several time-series databases on the market, such as influxDB, etc., but most of these databases use LSMtree-based storage solutions. For example, influxDB uses the variant TSM of LSMtree. The advantage of LSMtree is that the writing speed is fast, but due to the hierarchical search , its read data performance is not ideal. Contents of the invention [0003] Considering the characteristics of time series data (many writes, many reads, but few updates and deletions), the present invention proposes a storage engine and a query executor based on columnar storage on the traditional database architecture, which can improve the query efficiency of the database system. [0004] The purpose of the present invention is achieved through the fol...

AI Technical Summary

Problems solved by technology

[0002] At present, there are several time-series databases on the market, such as influxDB, etc., but most of these databases use LSMtree-based storage solutions. For example, influxDB uses the variant TSM of LSMtree. The advantage of LSMtree is that the writing speed is fast, but due to the hierarchical search , its read data performance is not ideal

Images