Hierarchical data verification method and device, equipment and medium

Abstract

The invention discloses a hierarchical data verification method and device, equipment and a medium, and the method comprises the steps: responding to a data model adding instruction which is pushed by a development end and acts on a hierarchical data warehouse, obtaining a plurality of calculation tasks contained in a new data model, and obtaining a standard table name of a model data table; performing test operation on each calculation task, generating resource consumption data representing calculation resources consumed by the calculation tasks, and determining respective reference data tables of the calculation tasks; performing upstream and downstream traceability on each reference data table based on the data hierarchy of the standard table name of the model data table, and drawing a data table mapping relation graph; and according to the model data table and the standard table name of each reference data table, performing hierarchical verification on the reference data table, and matching a recommendation data table superior to the reference data table referenced in a cross-layer or staggered-layer manner for the data model. The quality of the data table in the hierarchical data warehouse is effectively managed, and the calculation efficiency of the data model in the warehouse is improved.

Description

technical field [0001] The present application relates to the field of database management, and in particular, to a method for verifying hierarchical data, and also relates to apparatuses, devices and non-volatile storage media corresponding to the method. Background technique [0002] Existing Internet platforms will use hierarchical data warehouses to store data and data tables in the platform. For example, Internet live broadcast platforms will usually aggregate the data of live broadcast rooms, anchor users and audience users on the platform into relevant data. The data tables required by the live online service, and the data tables in the hierarchical data warehouse also refer to the data tables stored in the warehouse, by developing the corresponding data model to obtain data from the corresponding data source for the associated data table, and then other Get aggregated data from datasheets and create new datasheets to apply to newly deployed online services on the pla...

AI Technical Summary

Problems solved by technology

[0003] However, when the data tables in the existing hierarchical data warehouse refer to other data sources in the warehouse, there are often cases of cross-level references or cross-level references. When the data model obtains data from its data tables with cross-level or cross-level references, it will waste excessive computing resources

[0004] Moreover, when platform developers inquire whether there are cross-layer or cross-layer references in the data model they develop, they can often only check the complicated codes in the calculation tasks of the data model, which is too inefficient to effectively manage the distribution. Layer data warehouse, and developers can only manually query whether there is a data source suitable for reference in the layered data warehouse when developing the data model, and the development efficiency is also very low

Images