Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for compressing time sequence data and method and device for querying time sequence data

A time-series data and query time technology, applied in the field of cloud computing, can solve problems such as low compression rate, inability to compress historical data for a long time, and inability to obtain high compression rate of time-series data, so as to reduce restrictions and improve compression rate Effect

Active Publication Date: 2018-05-29
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the prior art compresses the time series data, there are the following disadvantages: the compression rate is not high, for example, when using OpenTsdb to compress, only the data files generated by the time series database are compressed, so the high compression rate of the time series data cannot be obtained; The time-series data imported has many restrictions. For example, Gorilla of Facebook, although using this algorithm can obtain a high compression rate for time-series data, but it requires that the time-series data to be written must be within a certain range of the current timestamp, and the time-series data cannot be compressed. Compression of longer historical data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for compressing time sequence data and method and device for querying time sequence data
  • Method and device for compressing time sequence data and method and device for querying time sequence data
  • Method and device for compressing time sequence data and method and device for querying time sequence data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0029] Terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0030] It should be understood that the term "and / or" used herein is only an association relationship describing associated objects, which means that there may be three relationships, for example, A and / or B, which may mean that A exists alone, and A and B exist simultaneously. B, there are three situations of B alone. In addition, the character " / " in this articl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for compressing time sequence data. The method comprises the steps of writing obtained time sequence data into a temporary table; determining to-be-compressed time sequence data from the temporary table according to a query time range; compressing the to-be-compressed time sequence data, then writing the compressed time sequence data into a final table, judging whether a current query time range can be updated or not, if the current query time range can be updated, turning to the step of determining the to-be-compressed time sequence data from the temporary table after the query time range is updated; and if the current query time range cannot be updated, compressing a compression result of the time sequence data written into the final table. The invention also provides a method for querying the time sequence data. The method comprises the steps of obtaining a generation time range of to-be-queried time sequence data; comparing marking time in a query time range employed when first compression is carried out with the generation time range, and determining a storage position of the to-be-queried time sequence data according to a comparison result, wherein the storage position comprises the temporary table and / or the final table; and obtaining the to-be-queried time sequence data according to the determined storage position.

Description

【Technical field】 [0001] The invention relates to the field of cloud computing, in particular to a method and device for compressing time series data and querying time series data. 【Background technique】 [0002] Time-series data can be used to analyze the past, monitor the present, and predict the future. For enterprises, time-series data is of inestimable value. Therefore, it is necessary to store time series data. However, the time-series data in existing scenarios is characterized by a large amount of data, and the resulting problem is that the cost of storing time-series data is high. In order to reduce the storage cost of time series data, it is generally realized by compressing the time series data. However, when the prior art compresses the time series data, there are the following disadvantages: the compression rate is not high, for example, when using OpenTsdb to compress, only the data files generated by the time series database are compressed, so the high compr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H03M7/30G06F3/06
CPCG06F3/0608G06F3/0656H03M7/70
Inventor 沈达宇
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products