Method for carrying out non-stop data migration by utilizing MySQL Binlog

A data and database technology, applied in the field of non-stop data migration using MySQLBinlog, can solve the problems of not being allowed, reducing application availability time and availability, etc., and achieve the effect of ensuring correctness and real-time availability

Inactive Publication Date: 2019-12-03
政采云有限公司
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But stopping the service will reduce the available time and usability of the application, which is not allowed for some key applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for carrying out non-stop data migration by utilizing MySQL Binlog
  • Method for carrying out non-stop data migration by utilizing MySQL Binlog
  • Method for carrying out non-stop data migration by utilizing MySQL Binlog

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention.

[0034] refer to Figure 1-3 , using MySQL Binlog for non-stop data migration method, including the following steps:

[0035] SSO1: Configure DTS on the source database to be migrated, DTS will migrate all the data on the source database to be migrated to the intermediate database, and the incremental data generated during the process of migrating all the data on the source database to be migrated will also Migrate to the intermediate database through DTS;

[0036] SSO2: Deploy Canal middleware to monitor the Binlog generated by the intermediate database and store it in MQ;

[0037] SSO3: Deploy a self-developed data conversion and migration program. On the one hand...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for carrying out non-stop data migration by utilizing MySQL Binlog. The method comprises the following steps that a DTS is configured on a to-be-migrated source database, the DTS can migrate all data on the to-be-migrated source database to an intermediate database, and incremental data generated in the process of migrating all the data on the to-be-migrated sourcedatabase can also be migrated to the intermediate database through the DTS. In the present invention, an incremental data migration function is provided through DTS; the data generated by the servicein the non-stop period can be continuously written into the intermediate database; and the intermediate database continuously generates Binlog, the Binlog is consumed by a self-developed data conversion migration program through the Canal and the message queue, and finally, the Binlog is stored in the target database, so that no shutdown is realized in the whole process, namely, the service is not paused, and the real-time availability of the service is ensured.

Description

technical field [0001] The invention relates to the technical field of data migration, in particular to a method for non-stop data migration using MySQL Binlog. Background technique [0002] In the process of business development, we often need to regulate the existing business and reconstruct and modify the data model. If the data model changes, the corresponding database table structure will also change, such as field type, data dimension, etc. will change. At this time, data migration is required. Traditional data migration is based on stopping the server, that is, the application stops external services and closes the read and write traffic. However, stopping the service will reduce the available time and usability of the application, which is not allowed for some key applications. So we need a way to migrate without stopping. Contents of the invention [0003] The purpose of the present invention is in order to solve the shortcoming that exists in the prior art, a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/25G06F16/27
CPCG06F16/214G06F16/258G06F16/27
Inventor 姚宇帆易锋
Owner 政采云有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap