Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for supporting automatic data synchronization of multi-source heterogeneous database

An automatic synchronization, multi-source heterogeneous technology, applied in database indexing, database updating, structured data retrieval, etc., can solve problems such as long delay time, low operation efficiency, and impact, and achieve high real-time performance, high performance, and efficiency high effect

Pending Publication Date: 2022-01-21
畅移(上海)信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Disadvantages of existing technologies: 1. Multiple data source scenarios are not supported
2. Unable to switch autonomously between full synchronization and incremental synchronization according to the actual situation
3. The comparison system needs to scan the entire table every time to find out the difference between the source database and the destination database. This operation is inefficient and has a long delay
4. During the synchronization process, other existing services in the source library may be affected

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for supporting automatic data synchronization of multi-source heterogeneous database
  • Method and system for supporting automatic data synchronization of multi-source heterogeneous database
  • Method and system for supporting automatic data synchronization of multi-source heterogeneous database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] Such as figure 2 and image 3 As shown, a system that supports automatic data synchronization of multi-source heterogeneous databases, including source databases, producer units, subscriber units, configuration centers and destination databases;

[0047] The producer unit is used to obtain the source database configuration to be synchronized from the configuration center, and judge whether the synchronization version number of the table is different from the synchronization version number of the connection according to the configuration information of the source database; The table is fully synchronized to the queue; then, the DML statement in the source database log is monitored, and the data to be synchronized is synchronized to the queue;

[0048] The subscriber unit is used for real-time consumption of data and tables in the queue, and transfers the consumed data and tables to the destination database;

[0049] Such as Figure 4 As shown, the configuration cente...

Embodiment 2

[0058] Such as Figure 5 As shown, a method for automatically synchronizing data supporting multi-source heterogeneous databases includes the following steps:

[0059] Step 1. Obtain the configuration information of the source database that needs to be synchronized; the configuration information is pre-existing in the configuration center, and the configuration information includes the connection information of the source database, such as the connection address, account, password, etc. of the source database, and also includes Information such as the current version and data structure of the source database;

[0060] Step 2. According to the configuration information of the source database, judge whether there is a table whose synchronization version number is different from that of the connection; if yes, go to step 3; if not, go to step 4;

[0061] Step 3. Synchronize all tables with different synchronization version numbers to the queue; after completion, set the synchron...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a system for supporting automatic data synchronization of a multi-source heterogeneous database. The method comprises the following steps: collecting configuration information of a source database needing to be synchronized; judging whether the synchronization version number of the table is different from the synchronization version number of the connection or not according to the configuration information of the source database; if yes, performing full-quantity synchronization on the tables with different synchronization version numbers to a queue; after synchronization is completed, the synchronization version number of the table and the synchronization version number of the connection are set to be consistent, and if not, DML statements in a source database log are monitored, and data needing to be synchronized are synchronized into a queue; and synchronizing the table and the data in the queue into a target database in real time. Through queue deconstruction, synchronization of any multiple data sources is supported, whether the data sources are isomorphic or heterogeneous.

Description

technical field [0001] The invention belongs to the technical field of data synchronization, and in particular relates to a method and system for supporting automatic data synchronization of multi-source heterogeneous databases. Background technique [0002] Such as figure 1 As shown, for data synchronization between multi-source heterogeneous databases, the existing technical solutions are generally: first compare the structure and data differences between the two, generate DDL and DML statements according to the differences, and then execute these statements on the target database , to achieve the purpose of data synchronization. [0003] Disadvantages of existing technologies: 1. The scenario of multiple data sources is not supported. 2. It is impossible to switch between full synchronization and incremental synchronization independently according to the actual situation. 3. The comparison system needs to scan the entire table every time to find out the difference betw...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/22G06F16/23G06F16/2457G06F16/27
CPCG06F16/219G06F16/2282G06F16/2365G06F16/24578G06F16/27
Inventor 凌生龙赵永卢虹吴城
Owner 畅移(上海)信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com