Real-time data calculation method, device and equipment and computer readable storage medium

Abstract

The invention discloses a real-time data calculation method. The real-time data calculation method comprises the following steps: when a configuration instruction sent by a configuration end is received, analyzing the configuration instruction to obtain configuration information; generating calculation task is generated according to the configuration information, calculating a data source according to the calculation task, and storing a calculation result in a preset Hbase database; When a data real-time calculation request sent by a query end is received, obtaining corresponding target indexinformation and a target time range according to the data real-time calculation request; According to the target index information and the target time range, obtaining corresponding index data from the preset Hbase database according to a preset rule, and obtaining a real-time value through calculation according to the index data. The invention further discloses a data real-time calculation deviceand equipment and a computer readable storage medium. According to the invention, the development cost can be reduced, and the code reuse rate is improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a real-time data calculation method, device, equipment and computer-readable storage medium. Background technique [0002] In recent years, with the development of information communication technology and the Internet, there are more and more big data scenarios, and there are various real-time data computing services. Currently popular real-time computing engines include strom (native real-time stream processing framework), sparkstreaming (quasi-real-time stream processing framework that regards stream as micro-batch processing), flink (native real-time stream processing framework), etc. When using any of them, it is necessary to write computing tasks case by case for each scenario. For example, when calculating an indicator with a time range dimension such as "the last 7 days", it is necessary to write a calculation task including the real-time calculation task ...

AI Technical Summary

Problems solved by technology

For example, when calculating an indicator with a time range dimension such as "the last 7 days", it is necessary to write a calculation task including the real-time calculation task of the current day and the batch calculation task of the 6th history to calculate the real-time indicator value of the current day and the last 6 days Daily batch index value; and when changing the time range of the index, such as "last 3 days", a new batch task needs to be rewritten to recalculate the batch index value of the past 2 days, resulting in relatively high development costs High, low code reuse rate

Images