Data convergence and divergence method and system for multi-source heterogeneous database

Abstract

The present invention is suitable for the field of data and provides a data convergence and divergence method and system for a multi-source heterogeneous database. The method comprises: a multi-source data integration system collects data information, then integrates the collected data information and stores the collected data information into a target database; a data distribution system receives the data information of the multi-source data integration system, and according to application requirements of each application database in an application database system, distributes the data information to the application database; and each application database receives the data information distributed by the data distributed system, respectively performs data usage and data update on the distributed data information in a practical application process, and then the application database system sends the updated data information to the multi-source data integration system. According to the method provided by the present invention, the data can be recycled in a data convergence and divergence cyclic method.

Description

technical field [0001] The invention relates to the field of data, in particular to a multi-source heterogeneous database data gathering and distributing method and system. Background technique [0002] We are currently in the era of big data, which has the following characteristics: [0003] 1). The era of big data has come quietly. Big data will gradually become a part of modern facilities, just as indispensable as roads, railways, ports, hydropower and communication networks. But in terms of its value characteristics, big data is different from these physical infrastructures. It will not depreciate because of people's use, but will become more abundant and comprehensive. For example, a set of DNA may die or perish, but digitized DNA lives on forever. Therefore, political science, sociology, and many scientific disciplines in the era of big data will undergo huge and even essential changes and developments, which in turn will affect human value systems, knowledge system...

AI Technical Summary

Problems solved by technology

In today's era of big data, if data integration cannot be realized, the data will not be used on demand, and the data will not be able to fully flow, resulting in the inability to fully tap and utilize the value of the data

[0008] Existing technical solutions for data integration are usually implemented using commercial software, but usually only a special type of database system integration can be achieved, and data on-demand distribution and data circulation flow cannot be realized. For example, the GoldenGate launched by Oracle Corporation can only To realize the integration from multiple Oracle databases to a certain Oracle database, it is impossible to realize the integration of MySQL database to Oracle database; in addition, these commercial software are not only expensive, but also closed source, and cannot be customized and developed according to the needs of users. At the same time, data security and data privacy are also very important. In the post-"prism door" era, it is usually impossible to perform security testing on these closed-source commercial software, and it is impossible to determine whether there is a backdoor.

Images