Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for realizing incremental data extract based on CDC (Change Data Capture) mode

A technology of incremental extraction and data, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as performance gaps and high network loads, reduce network loads, improve operating performance, and reduce data transmission volume Effect

Inactive Publication Date: 2016-09-28
南京优测信息科技有限公司
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional incremental extraction technology generally has the method of adding a timestamp to the original table and comparing it with the whole table. It needs to modify the structure of the original table or use a large number of algorithms to realize it. At the same time, more data needs to be transmitted, resulting in a higher network cost. Compared with the CDC technology directly integrated with the database engine, there is a certain gap in performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing incremental data extract based on CDC (Change Data Capture) mode
  • Method for realizing incremental data extract based on CDC (Change Data Capture) mode
  • Method for realizing incremental data extract based on CDC (Change Data Capture) mode

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0020] see figure 1 , which is the structure diagram of the incremental data extraction method provided by the CDC method provided by the present invention. The method provided by the present invention includes the following steps: the first step is to create the same table structure in the database of the data source and the data target according to the business scenario database table, and then create a data operation log cache table in the source database.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for realizing incremental data extract based on a CDC (Change Data Capture) mode and belongs to the application field of computer networks and database technologies. The method comprises the following steps of: firstly, providing a set of complete and feasible solution schemes for incremental data synchronism from a source database table to a target database table; secondly, carrying out incremental extract by using a CDC technology without modifying a source list data structure. According to the method, while the operating performance of a system is improved, the data transmission quantity is reduced and the network load is alleviated.

Description

technical field [0001] The invention belongs to the application field of computer network and database technology, mainly relates to an incremental extraction and data synchronization method of an Oracle database, and specifically relates to a method for realizing incremental extraction of data based on a CDC mode. Background technique [0002] CDC (Change Data Capture) is an incremental data processing technique that helps you identify data that has changed since the last fetch. Using CDC technology, data can be extracted while performing operations such as INSERT, UPDATE or DELETE on the source table, and the changed data is saved in the change table of the database. This makes it possible to capture changed data and then make it available to the target system in a controlled manner using database views. The traditional incremental extraction technology generally has the method of adding a timestamp to the original table and comparing it with the whole table. It needs to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/254
Inventor 游辉敏
Owner 南京优测信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com