Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for aggregation optimization of time series data

A time-series data and processing method technology, which is applied in the field of data processing, can solve problems that affect system performance and greatly increase the number of disk IOs, and achieve the effect of fast and efficient query and scan

Pending Publication Date: 2019-01-08
TAOS DATA
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, compared to the need to scan the database file once for each time series, multiple time series need to open and scan the database file multiple times, which will greatly increase the number of disk IOs and affect system performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for aggregation optimization of time series data
  • A method for aggregation optimization of time series data
  • A method for aggregation optimization of time series data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0075] Performance comparison before and after optimization:

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for aggregation optimization of temporal data includes dividing a temporal database file into a data block file and a block index file; scanning the block index file according to the calculated start and end time period, extracting the data blocks that meet the time period condition and other filtering conditions, and sorting according to the offset of each data block in the data block file; scanning the data files inexpensively by sorted data blocks, after the calculation of each data block, gathering the calculation results. The method can be completed by opening a data file for scanning whether it is for reading a single time series data or for aggregating multiple time series data, which greatly improves the overall performance.

Description

technical field [0001] The invention relates to the field of data processing, in particular to an aggregation optimization processing method for time series data. Background technique [0002] Time series data refers to time series data, which is a data column recorded in chronological order. There is a special time series database to handle the storage and query of time series data. [0003] In the prior art, a time-series database usually contains multiple time-series data. In addition to reading a single time-series data, it is usually necessary to aggregate and calculate multiple time-series data. The usual practice is to process each time series separately, get the results, put them in the cache, and then aggregate the results. [0004] However, compared to the need to scan the database file once for each time series, multiple time series need to open and scan the database file multiple times, which will greatly increase the number of disk IOs and affect system perform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F16/22G06F16/2458
CPCG06F3/061G06F3/064G06F3/0643G06F3/0673G06F16/24552G06F12/0868G06F2212/502G06F2212/463G06F2212/163G06F16/2477G06F3/0655
Inventor 廖浩均关胜亮程洪泽陶建辉
Owner TAOS DATA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products