Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Huge transaction increment synchronization method between transactional databases

An incremental synchronization and database technology, applied in database distribution/replication, structured data retrieval, digital data processing, etc., can solve the problems of high cost and efficiency of resuming transmission after breakpoint, and achieve low cost of resuming transmission, The effect of controllable performance and hardware overhead

Active Publication Date: 2022-02-01
TIANJIN NANKAI UNIV GENERAL DATA TECH
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention aims to propose a method for synchronizing huge transaction increments between transactional databases to solve the problems of memory, high cost and efficiency of resuming transmission of huge transactions during synchronization of huge transactions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Huge transaction increment synchronization method between transactional databases

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0097] 1. First create a transaction scenario in the customer business system:

[0098] 1. Database A of the customer source business system is installed on server one, and the IP address of server one is 172.10.1.5

[0099] 2. The target database B is installed on the second server, and the IP address of the second server is 172.10.2.5

[0100] 3. Both the source database and the target database contain corresponding tables: T1, T2, T3, T4, T5

[0101] 4. Customers of the source database business system will uniformly update the detailed status at the end of the year, and update 10 million pieces of data in batches;

[0102] 5. Set the maximum allowable storage of 10,000 pieces of data in the memory, and set the transaction split threshold to 10,000 pieces;

[0103] The above business scenarios and settings are completed.

[0104] like figure 1 The redo SQL process of the transaction in the frame diagram shown is as follows:

[0105] 1) Check the breakpoint resume inform...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a huge transaction increment synchronization method between transactional databases. The method specifically comprises the following contents that: a logic log in a business system database is analyzed through a log stream mining module, a redo SQL obtained after analyzing the logic log is sent to a transaction restoration module for transaction restoration, if the length of the transaction exceeds a set length threshold value in the restoration process, the transaction needs to be split, the transaction is written into the target database through the data delivery module after splitting, and if the length does not exceed the length threshold value, the transaction is directly written into the target database. According to the method for incremental synchronization of the huge transactions between the transactional databases, incremental synchronization of the huge transactions of a source library is achieved on the premise that data consistency and memory controllability are guaranteed.

Description

technical field [0001] The invention belongs to the technical field of incremental synchronization between homogeneous databases or heterogeneous databases in the field of OLTP databases, and in particular relates to a huge transaction incremental synchronization method between transactional databases. Background technique [0002] With the development and maturity of the domestic database market, enterprises have more choices of databases for transaction systems in the process of informatization construction. In an enterprise, different information systems often have multiple sets of different databases. With the development of enterprise information systems, the data between these databases gradually generate mutual synchronization requirements. OLTP databases have logical logs. In order to reduce the intrusion of user application systems, the incremental synchronization of such databases often adopts the method of obtaining incremental data based on parsing logical logs t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/27G06F11/14
CPCG06F16/275G06F16/2433G06F11/1458
Inventor 赵伟田志敏
Owner TIANJIN NANKAI UNIV GENERAL DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products