Data synchronization method and device for master and slave nodes of database

Abstract

The invention discloses a data synchronization method and device for master and slave nodes of a database. The method comprises the following steps: starting an output log function of a time sequencetype database on a master node and determining a format of an output log; configuring and starting a master-slave synchronizer of the time sequence type database to continuously monitor an output logof the master node; analyzing all editing operations aiming at the time sequence type database based on the time sequence from the output log; in response to the offline state of the slave node, caching the editing operation as a to-be-synchronized operation into a lightweight database of the master node; in response to the slave node being online, synchronizing the editing operation and the cached to-be-synchronized operation to the slave node. Master-slave data synchronization and master-slave switching can be normally executed offline in the master-slave database, and data integrity is guaranteed.

Description

technical field [0001] The present invention relates to the field of storage, more specifically, to a method and device for synchronizing data between master and slave nodes of a database. Background technique [0002] Using traditional relational databases to store time series has many disadvantages. For example, in the case of a large amount of data, the slow query speed is not user-friendly, and the storage is not optimized and takes up a lot of disk space. As an open source time-series data, influxdb focuses on querying and storing time-series data with high performance, but it does not have the master-slave synchronization function, that is, it does not support clusters. If you need to achieve master-slave data synchronization, basically write data to the master-slave node at the same time when writing data. Although this method can solve the problem of master-slave synchronization, it is not the optimal way, because the master-slave Storing data in the database at th...

AI Technical Summary

Problems solved by technology

For example, in the case of a large amount of data, the slow query speed is not user-friendly, and the storage is not optimized to take up a lot of disk space, etc.

As an open source time series data, influxdb focuses on querying and storing time series data with high performance, but it does not have master-slave synchronization function, that is, it does not support clusters

If you need to achieve master-slave data synchronization, basically write data to the master-slave node at the same time when writing data. Although this method can solve the problem of master-slave synchronization, it is not the optimal way, because the master-slave Storing data in the database at the same time will take up a lot of bandwidth, and once the master / slave database goes offline, it will cause data loss, which will be very serious

[0003] There is currently no effective solution to the problem that data loss may be caused by master-slave synchronization in the prior art

Images