Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data synchronization method and device, electronic equipment and storage medium

A data synchronization and database technology, applied in the database field, can solve problems such as data synchronization and achieve the effect of improving efficiency

Active Publication Date: 2022-06-24
金篆信科有限责任公司
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the embodiment of this application is to propose a data synchronization method, device, electronic equipment, and storage medium, which can prevent unsubmitted data from being synchronized to the downstream database and solve the problem of Uncommitted Read Issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device, electronic equipment and storage medium
  • Data synchronization method and device, electronic equipment and storage medium
  • Data synchronization method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the objectives, technical solutions and advantages of the embodiments of the present application more clear, each embodiment of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art can understand that, in each embodiment of the present application, many technical details are provided for the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solutions claimed in the present application can be realized. The following divisions of the various embodiments are for the convenience of description, and should not constitute any limitation on the specific implementation of the present application, and the various embodiments may be combined with each other and referred to each other on the premise of not contradicting each other.

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to the field of databases, in particular to a data synchronization method and device, electronic equipment and a storage medium. The data synchronization method provided by the invention comprises the following steps: acquiring a to-be-played-back sub-transaction log according to a fragmented transaction log; detecting whether a global transaction to which the to-be-played-back sub-transaction log belongs belongs to a submitted global transaction or not according to a global transaction snapshot table updated in a preset period; wherein the global transaction snapshot table is used for recording the submission state of the global transaction; and after determining that the global transaction to which the to-be-played-back sub-transaction log belongs belongs to the submitted global transaction, the to-be-played-back sub-transaction log is played back to the downstream database, so that the problem that unsubmitted data is synchronized to the downstream database is avoided, and in addition, the embodiment takes fragments as granularity, so that the data synchronization efficiency is improved. And the fragments in the distributed database determine the sub-transaction logs capable of being played back according to the global transaction snapshot table, so that concurrence among the fragments is realized conveniently, and the data synchronization efficiency is improved.

Description

technical field [0001] The embodiments of the present application relate to the field of databases, and in particular, to a data synchronization method, apparatus, electronic device, and storage medium. Background technique [0002] As a transaction-oriented processing system (On-Line Transaction Processing, referred to as "OLTP"), a distributed database needs to periodically unload data to an analysis system, such as a data warehouse, for subsequent analysis and processing by other systems. There are multiple data shards in a distributed database, and concurrent data synchronization between shards has high performance. When the distributed database unloads the data to the analysis system, it will replay the sub-transaction log of the global transaction generated by each shard to the downstream database. . [0003] However, there is a global transaction across shards in a distributed database, and the global transaction across shards includes multiple sub-transactions. When...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/23G06F9/46
CPCG06F16/278G06F16/275G06F16/2308G06F9/466G06F16/23G06F16/27G06F9/46
Inventor 周日明
Owner 金篆信科有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products