A method for aggregation optimization of time series data
A time-series data and processing method technology, which is applied in the field of data processing, can solve problems that affect system performance and greatly increase the number of disk IOs, and achieve the effect of fast and efficient query and scan
Pending Publication Date: 2019-01-08
TAOS DATA
View PDF5 Cites 18 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] However, compared to the need to scan the database file once for each time series, multiple time series need to open and scan the database file multiple times, which will greatly increase the number of disk IOs and affect system performance.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0075] Performance comparison before and after optimization:
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More
Abstract
A method for aggregation optimization of temporal data includes dividing a temporal database file into a data block file and a block index file; scanning the block index file according to the calculated start and end time period, extracting the data blocks that meet the time period condition and other filtering conditions, and sorting according to the offset of each data block in the data block file; scanning the data files inexpensively by sorted data blocks, after the calculation of each data block, gathering the calculation results. The method can be completed by opening a data file for scanning whether it is for reading a single time series data or for aggregating multiple time series data, which greatly improves the overall performance.
Description
technical field [0001] The invention relates to the field of data processing, in particular to an aggregation optimization processing method for time series data. Background technique [0002] Time series data refers to time series data, which is a data column recorded in chronological order. There is a special time series database to handle the storage and query of time series data. [0003] In the prior art, a time-series database usually contains multiple time-series data. In addition to reading a single time-series data, it is usually necessary to aggregate and calculate multiple time-series data. The usual practice is to process each time series separately, get the results, put them in the cache, and then aggregate the results. [0004] However, compared to the need to scan the database file once for each time series, multiple time series need to open and scan the database file multiple times, which will greatly increase the number of disk IOs and affect system perform...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F16/22G06F16/2458
CPCG06F3/061G06F3/064G06F3/0643G06F3/0673G06F16/24552G06F12/0868G06F2212/502G06F2212/463G06F2212/163G06F16/2477G06F3/0655
Inventor 廖浩均关胜亮程洪泽陶建辉
Owner TAOS DATA
Who we serve
- R&D Engineer
- R&D Manager
- IP Professional
Why Patsnap Eureka
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com