A binlog log data adaptation migration method and system

A data adaptation and log technology, applied in the Internet field, can solve problems such as increased costs, inconsistent binlog structure and business scenarios, and inflexible business processing.

Active Publication Date: 2022-05-31
TIANGU INFORMATION SCI TECH HANGZHOU
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above-mentioned existing technologies have the following technical defects: when facing the docking work outside the enterprise, the binlog structure and business scenarios are highly inconsistent due to the design of the library table and business differentiation, so that each enterprise has to do a lot of customization Business development work, thus increasing the cost of the enterprise, and even a customized business development system, there will also be problems of inflexible business processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A binlog log data adaptation migration method and system
  • A binlog log data adaptation migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following description serves to disclose the invention to enable those skilled in the art to practice the invention. The preferred embodiments described below are given by way of example only, and other obvious modifications will occur to those skilled in the art. The basic principles of the invention defined in the following description may be applied to other embodiments, variations, improvements, equivalents, and other technical solutions without departing from the spirit and scope of the invention.

[0025] It should be understood by those skilled in the art that in the disclosure of the present invention, the terms "portrait", "horizontal", "upper", "lower", "front", "rear", "left", "right", " The orientation or positional relationship indicated by vertical, horizontal, top, bottom, inner, outer, etc. is based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the present invention and to simpli...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and system for adapting and migrating Binlog log data. The method comprises the following steps: obtaining Binlog log data, setting a verification function of the Binlog log data; verifying the Binlog log data according to the verification function , obtain the legal Binlog log data; configure the rule engine, generate the business data of the rule according to the rule engine; obtain the mapping rule from the rule engine, and generate the request packet of the corresponding interface according to the mapping rule; from the rule engine Obtain the response verification rule in the method, and verify the Binlog log data according to the response verification rule after obtaining the response data packet of the corresponding interface. The Binlog log receiving layer obtains the data message of the data replication center, and the data message is sent to the Binlog log verification layer, and the Binlog log verification layer is used to verify the legality of the data message, and through the Binlog log The verification layer setting verification function can filter data packets of specified business scenarios, so that an adaptive data migration strategy can be formulated.

Description

technical field [0001] The invention relates to the field of the Internet, and in particular to a Binlog log data adaptation and migration method and system Background technique [0002] Common RDBMS synchronization application scenarios are mostly backup or synchronization operations, such as master-slave replication. Based on database Binlog change events, it can be used for solutions in other richer scenarios, such as database monitoring. Because the internal database table structure and business abstraction are highly unified, Therefore, enterprises can combine the binlog monitoring framework on the market, such as Canal, to realize incremental analysis of database logs and provide solutions for subscription consumption scenarios of incremental data. The above-mentioned prior art has the following technical defects: in the face of the docking work outside the enterprise, the binlog structure and the business scenario are highly inconsistent due to the design of the libra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/23G06F11/30G06F16/21G06F16/215G06F16/27
CPCG06F16/2358G06F11/3065G06F11/3093G06F16/214G06F16/215G06F16/27G06F2201/80
Inventor 刘永建杨道铨金雄镕王锶锶金宏洲程亮
Owner TIANGU INFORMATION SCI TECH HANGZHOU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products