Binlog data adaptive migration method and system

A data adaptation and log technology, applied in the Internet field, can solve problems such as inflexible business processing, increased cost expenditure, and inconsistency between binlog structure and business scenarios

Active Publication Date: 2021-07-02
TIANGU INFORMATION SCI TECH HANGZHOU
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above-mentioned existing technologies have the following technical defects: when facing the docking work outside the enterprise, the binlog structure and business scenarios are highly inconsistent due to the design of the library table and business differentiation, so that each enterprise has to do a lot of customization Business development work, thus increasing the cost of the enterprise, and even a customized business development system, there will also be problems of inflexible business processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binlog data adaptive migration method and system
  • Binlog data adaptive migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following description serves to disclose the present invention to enable those skilled in the art to carry out the present invention. The preferred embodiments described below are only examples, and those skilled in the art can devise other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents and other technical solutions without departing from the spirit and scope of the present invention.

[0025] Those skilled in the art should understand that in the disclosure of the present invention, the terms "vertical", "transverse", "upper", "lower", "front", "rear", "left", "right", " The orientation or positional relationship indicated by "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, which are only for the convenience of describing the present invention...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Binlog data adaptive migration method and system, and the method comprises the following steps: obtaining Binlog data, and setting a verification function of the Binlog data; according to the verification function, verifying the Binlog data, and obtaining legal Binlog data; configuring a rule engine, and generating business data of a rule according to the rule engine; obtaining a mapping rule from the rule engine, and generating a request data packet of a corresponding interface according to the mapping rule; and obtaining a response verification rule from the rule engine, and verifying the Binlog data according to the response verification rule after obtaining a response data packet of a corresponding interface. A Binlog receiving layer obtains a data message of a data replication center and sends the data message to a Binlog verification layer, the Binlog verification layer is used for verifying the legality of the data message, and the data message of a specified service scene can be screened by setting a verification function for the Binlog verification layer, so that an adaptive data migration strategy can be formulated.

Description

technical field [0001] The present invention relates to the Internet field, in particular to a method and system for adapting and migrating Binlog log data Background technique [0002] Common RDBMS synchronization application scenarios are mostly backup or synchronization operations, such as master-slave replication. Based on database Binlog change events, it can be used in other richer scenarios, such as database monitoring. Because the internal database table structure and business abstraction are highly unified, Therefore, enterprises can combine binlog monitoring frameworks on the market such as Canal to realize incremental analysis of database logs and provide solutions for incremental data subscription consumption scenarios. The above-mentioned existing technologies have the following technical defects: when facing the docking work outside the enterprise, the binlog structure and business scenarios are highly inconsistent due to the design of the library table and bus...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/23G06F11/30G06F16/21G06F16/215G06F16/27
CPCG06F16/2358G06F11/3065G06F11/3093G06F16/214G06F16/215G06F16/27G06F2201/80
Inventor 刘永建杨道铨金雄镕王锶锶金宏洲程亮
Owner TIANGU INFORMATION SCI TECH HANGZHOU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products