Method and device for querying OLAP (on-line analytical processing) in real time

Abstract

The invention relates to a method and a device for querying OLAP (on-line analytical processing) in real time. The method comprises the following steps of obtaining dimension table information, fact table information and query parameters of a to-be-queried file sent by a client; according to the query parameters and dimensional table information, filtering the corresponding dimensional table, and building a multi-dimensional Bloom filter according to the filtering results; transmitting the multi-dimensional Bloom filter to each node in a broadcasting way, and filtering cube data corresponding to the fact table information; connecting the filtered dimensional table and the filtered cube data, so as to obtain query result; sending the query result to the corresponding query request client. The method has the advantages that the algorithm is quickly found by the multi-dimensional Bloom filter, the storage space is a bit vector, and the smaller storage space requirement is met; the fact table can be filtered in the broadcasting way, the passing number of I / O (input / output) is reduced, and the query efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a real-time OLAP query method and device. Background technique [0002] OLAP (On-Line Analytical Processing) is online analytical processing, which can help analysts, managers or executives to quickly, consistently and interactively access information from multiple perspectives and gain a deeper understanding of information. The goal of OLAP is to meet decision support Or meet specific query and report requirements in a multidimensional environment. [0003] Traditional OLAP systems use periodically updated data to statically calculate the entire cube or part of the cube to ensure user query performance. However, as people's demand for real-time data interactive analysis increases, such as real-time user behavior analysis on online shopping sites and product browsing and sales statistics, real-time OLAP (RTOLAP, Real Time OLAP) technology has gained widespread attention. Real-...

AI Technical Summary

Problems solved by technology

However, real-time calculations on real-time data require the support of a high-performance computing platform

[0004] In the traditional OLAP system, the dimension table needs to be constructed as a Hash table (hash table) in the star connection. The Hash table needs to occupy a large storage space. When it is broadcast to all nodes, a large amount of communication I / O is generated. cause inefficiency

Images