Data synchronization method, device and equipment and storage medium

A data synchronization and database technology, applied in the field of data processing, can solve problems such as cumbersome operations, slow data synchronization, and inability to achieve real-time performance

Pending Publication Date: 2021-01-05
CHINA CONSTRUCTION BANK
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In related technologies, the method of data synchronization can be realized through the acquisition platform, but the speed of data synchronization through this acquisition platform is slow and cannot achieve good real-time performance. Other data acquisition methods require manual operation, which is cumbersome and the data The synchronization frequency is slow and consumes human resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method, device and equipment and storage medium
  • Data synchronization method, device and equipment and storage medium
  • Data synchronization method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

[0029] Now is the era of data, and ensuring real-time data is a prerequisite for statistics and analysis of business data. In many business scenarios, we may involve data synchronization, which means synchronizing data from a source database to a target database. For example, based on user requirements, in the scenario where the data of multiple housing provident fund management centers needs to be synchronized to the specified target database in real time, the method to realize the data synchronization of housing...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data synchronization method and device, equipment and a storage medium. The method comprises the steps: obtaining incremental data in a past set time interval from a source table in a source database at set time intervals, and writing the incremental data into an intermediate table corresponding to the source table; writing the current time node information and the information of the intermediate table into a control table under the conditions that the incremental data is successfully obtained from the source table and the incremental data is successfully written into the intermediate table; taking the current time node information and the information of the intermediate table as to-be-executed task identifiers, and adding the to-be-executed taskidentifiers into a to-be-executed task queue; writing the incremental data of the intermediate table corresponding to the to-be-executed task in the to-be-executed task queue into a target table corresponding to a target database in sequence. According to the method disclosed in the technical scheme provided by the embodiment of the invention, the data synchronization can be accelerated, the pressure of the source database can be reduced, the real-time performance of the data is improved, and the manual operation cost is reduced.

Description

technical field [0001] Embodiments of the present invention relate to data processing technologies, and in particular, to a data synchronization method, device, equipment, and storage medium. Background technique [0002] Today is the era of data, ensuring real-time data is a prerequisite for statistics and analysis of business data. In many business scenarios, we may involve data synchronization, which means synchronizing data from a source database to a target database. [0003] In related technologies, the method of data synchronization can be realized through the acquisition platform, but the speed of data synchronization through this acquisition platform is slow and cannot achieve good real-time performance. Other data acquisition methods require manual operation, which is cumbersome and the data The synchronization frequency is slow and consumes human resources. Contents of the invention [0004] Embodiments of the present invention provide a data synchronization m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27
CPCG06F16/273
Inventor 卢名扬姚龙
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products