Metadata acquisition method and system based on drive dynamic loading

Abstract

The invention discloses a metadata acquisition method and system based on drive dynamic loading. The method comprises the following steps: acquiring database connection and authentication information data; analyzing the database connection and authentication information data to obtain database type data and database driving path data; acquiring a database needing to be connected according to the database type data, dynamically loading a drive according to database drive path data, dynamically loading or generating a bytecode file collected by metadata in the database according to the version of the drive, and loading the bytecode file; initializing the byte code file, establishing connection with a database, and testing connectivity with the database; if the connection with the database fails, feeding back connection failure; if the connection with the database is successful, starting to collect metadata in the database; performing format conversion on the obtained metadata and then storing the metadata; calling the converted metadata; the system comprises a client, a metadata acquisition gateway and a database end.

Description

technical field [0001] The invention relates to a method and system for collecting metadata, in particular to a method and system for collecting metadata based on dynamic loading of drivers. Background technique [0002] With the acceleration of digitalization, the amount of data has grown exponentially, and the emergence of big data-related technologies has also increased the demand for data governance, especially for large-scale enterprise business data, government government data, and industry standard data. The data storage structure is very different. Although the data contains a lot of valuable information, if you want to dig it out, you often need to do a lot of data governance work, and the cost is very high; [0003] Metadata management is the foundation of enterprise data governance. Metadata endows data with a frame of reference for context and meaning. Effectively governed metadata can provide data flow views, execution capabilities for impact analysis, common bu...

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is that metadata collection is difficult in existing data governance scenarios, and data governance is too complicated. The present invention provides a metadata collection method based on driver dynamic loading. Loaded metadata collection system, universal driver management, metadata collection gateway developed using plug-in framework and class loader isolation mechanism technology combined with Java reflection technology, dynamically supports various database drivers and different driver versions, and can cope with multiple heterogeneous environment without changing the code; the metadata format is unified, and the metadata information collected from various databases is automatically encapsulated inside the metadata collection gateway, and the agreed structured information is returned to keep the data format uniform, and external developers do not need to do Additional format conversion; metadata collection acceleration, the metadata collection gateway internally uses connection pool and cache technology, which can effectively control the collection frequency, and can quickly respond to interface calls; the development protocol is cross-platform, and the metadata collection gateway provides cross-language Rest interfaces. It can be integrated with any programming language, which is convenient for developers to connect to solve the defects caused by existing technologies

Images