Method, device, data transmission component and system for synchronizing data

Abstract

The invention provides a method, a device, a data transmission assembly and a system for synchronizing data. The method for synchronizing the data is applied to databases with master-slave structures, and includes acquiring the to-be-synchronized data from the master databases and generating a plurality of synchronization tasks according to the to-be-synchronized data; calling at least two concurrent threads, and distributing the multiple synchronization tasks to the concurrent threads according to preset rules; transmitting the multiple synchronization tasks to the slave databases by the aid of the concurrent threads so as to synchronize the data of the slave databases with the data of the master databases according to the multiple synchronization tasks. According to the technical scheme, the method, the device, the data transmission assembly and the system in an embodiment of the invention have the advantages that the problem of single-thread synchronization delay of existing master and slave databases can be solved, the data can be synchronized with one another in real time, and demands on providing follow-up service can be met.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a method, device, data transmission component and system for synchronizing data. Background technique [0002] MySQL is a relational database management system, and its master-slave architecture is currently one of the most used database architectures, especially for websites with relatively large loads. In MySQL's master-slave architecture, the master database performs operations such as writing, updating, and deleting, and executes these operations in the slave database through a predetermined synchronization strategy, so as to achieve data consistency in the master-slave database. [0003] In related technologies, the synchronization process of the MySQL master-slave database is: after operations such as writing, updating, and deleting have been performed on the MySQL master database, it will record these operations in the binary log (binary log), such as Figure 1A ...

AI Technical Summary

Problems solved by technology

[0004] However, when there are many operations such as writing, updating, and deleting on the master database, especially when the master database is triggered by a large number of businesses, there will be a large number of write requirements when synchronizing the slave database, but only one thread is running when the slave database is synchronizing. Playback and write operations are performed according to the recording order of the binary log. The single-thread processing speed of data is limited, and data exceeding its processing speed needs to be queued. Further increase the queue time

Therefore, when the master database writes a lot, the slave database synchronization will be delayed due to the limitation of single-thread processing speed, and the delay may become larger and larger due to the increase in the amount of data, which will lead to the inability to meet the subsequent data service requirements. needs

Images