A data synchronization method and device for a distributed heterogeneous database system

Abstract

The invention discloses a data synchronization method and device for a distributed heterogeneous database system. The method comprises the steps of obtaining one or more sets of operation instructionsand operation information, and sending the operation instructions and the operation information to a first database cluster, wherein the operation instructions comprise the insertion data, update data or deletion data, and the operation information comprises an operation position and a data value; receiving an operation result returned after the first database cluster modifies the data at the corresponding operation position according to each group of operation instructions and operation information; and according to each operation result, packaging the corresponding operation instruction andoperation information into a message to be sent out, wherein the message is used for carrying out data synchronization on the corresponding operation position in the second database cluster, so thatthe situation that the change of data cannot be perceived in time between different types of database systems is avoided, and the accuracy of data query and analysis is effectively improved.

Description

technical field [0001] The invention relates to the field of computer applications, in particular to a data synchronization method and device for a distributed heterogeneous database system. Background technique [0002] Today, with the explosive growth of information and data, big data has become an important strategic asset for enterprises. At present, big data processing is mainly divided into two categories: the first category is represented by OLAP (On-Line Analytical Processing, referred to as OLAP), which is aimed at massive data mining and complex analysis and calculation; the second category is online transaction processing. (On-line transaction processing, referred to as OLTP) as a representative, including traditional transaction operations and real-time access to massive data. In order to meet the above two types of data processing requirements at the same time, large enterprises will use different types of distributed database systems according to business scen...

AI Technical Summary

Problems solved by technology

[0003] In the existing distributed heterogeneous database system, different types of database systems are isolated from each other. When the content of the local data table changes, it is difficult for the remote data table to perceive the change in time.

For example, when a user inserts a piece of data into an OLTP database and then uses an OLAP database to analyze and process the same batch of data, because the user fails to perceive in time that the user has modified the data through the OLTP database, the user does not use the OLAP database for analysis. When processing, the original unmodified data is used, which will lead to inaccurate data analysis; in addition, when data synchronization is performed under the premise of large data volume, there will be pressure on network pressure, disk I / O, and storage capacity, which is very consuming Computing resources, seriously affecting normal business operations

Images