Time series data storage method and device, time series data reading method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a time series data storage method and device, a time series data reading method and device, electronic equipment and a storage medium. The time series data storage method comprises the steps that time series data to be stored is acquired, a storage position identifier is determined based on time series data items of the time series data, and the time series data comprises the time series data items, values of the time series data items and timestamps; determining a target cache block from a cache block set according to the storage position identifier,and determining a corresponding storage position from the target cache block according to the time sequence data item; and compressing the value and the timestamp of the time series data item by adopting a set compression algorithm, and storing the compressed data in a storage position. By the adoption of the technical scheme, the defect that a large amount of time series data occupy the storage space of equipment is overcome, and the space utilization rate is increased; besides, the compressed data associated with the time is cached, so that the problem of query delay caused by executing thequery instruction for multiple times can be avoided, and the query delay is reduced.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of databases, and in particular, to a method, device, electronic device, and storage medium for storing and reading time-series data. Background technique [0002] As the application of the Internet or the Internet of Things becomes more and more widespread, monitoring systems or Internet of Things devices in the Internet generate more and more time-series-based data, which are called time-series data. [0003] In related technologies, hotspot data within several hours are usually stored in memory for caching. For example, by means of a key-value pair, the time-series data item is used as a key to cache the value of the time-series data item. For other time series data that needs to be persisted, it is stored in OpenTSDB (Open time series data base, development time series database), Hbase (Hadoop Database, distributed database), InfluxDB (time series database) or Elasticsearch (no...

AI Technical Summary

Problems solved by technology

[0004] In the process of realizing the present invention, the inventors found that the data storage scheme in the related technology has at least the following problems: First, for the monitoring system or Internet of Things equipment in the Internet, about hundreds of millions of data are generated every day, and the data storage scheme in the related technology is adopted. The solution will occupy a large amount of device storage space and increase the cost of data storage

In actual scenarios, users usually focus on multiple records within a period of time, so multiple query commands need to be executed, resulting in high query delay

Images