Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data copying method and system based on different database

A data replication and database technology, applied in the field of database system applications, can solve the problems affecting the concurrent operation of the application server and the large local disk occupancy of the application server, achieve high-concurrency and large-batch data replication, and solve the problem of excessive disk load. Effect

Inactive Publication Date: 2016-04-20
CHINA CONSTRUCTION BANK
View PDF4 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the object of the present invention is to provide a data replication method and system based on different databases, aiming at solving the problem of the existing technology because the data needs to be stored on the application server as a local file, which leads to the occupation of the local disk of the application server. Larger, which in turn affects the concurrent operation of the application server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data copying method and system based on different database
  • Data copying method and system based on different database
  • Data copying method and system based on different database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] Embodiment 1 of the present invention discloses a data replication method based on different databases, refer to figure 1 , the method may include the following steps:

[0042] S101: Obtain target sub-data of a first preset size currently to be processed from target data; wherein, the target data is: data to be copied provided by a source database based on preset filter conditions.

[0043]S102: Write the target sub-data into a pipeline; the pipeline is a shared memory area of ​​a second preset size created in advance in the memory of the application server, and the value of the second preset size is not smaller than the first preset size Set the value of the size.

[0044] S103: Read the target sub-data from the pipeline, and write the read target sub-data into the target database; when the target data is not all written into the target database, go to execution The step S101: Acquiring target sub-data of a first preset size currently to be processed from the target ...

Embodiment 2

[0059] In the second embodiment of the present invention, refer to figure 2 , the method may also include the following steps:

[0060] S104: Count the number of first records of data obtained from the source database, count the number of second records of data written into the target database, and compare the number of records between the second number of records and the number of An error is reported when the number of first records is not equal.

[0061] Specifically, in this embodiment, the application server counts the number of records obtained from the source database and the number of records actually loaded into the target database. When the two are not equal, an error is reported, and this situation is fed back to the user, which is convenient for the user. Learn about the execution status of the current replication task.

Embodiment 3

[0063] In the third embodiment of the present invention, refer to image 3 , the method may also include the following steps:

[0064] S105: When the execution of the data unloading program or the data loading program fails, use a corresponding response mechanism to deal with it.

[0065] In this embodiment, the response mechanism when the execution of the data uninstall program fails includes:

[0066] When the pipeline is unwritable and unreadable, delete the pipeline;

[0067] When the pipeline is unwritable and readable, calling a system write command to write preset data to the pipeline, and deleting the pipeline after using the data loading program to read the preset data.

[0068] The response mechanism when the execution of the data loading program fails includes:

[0069] When the pipeline is unwritable and unreadable, delete the pipeline;

[0070] When the pipe is writable but not readable, a system read command is invoked to read the data in the pipe and delete ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The application discloses a data copying method and system based on different databases; the method and system build a shared memory area with a preset size in advance in an application server memory, and the memory area serves as a data transfer channel (or channel file) between a source database and a target database for data copying; the channel is employed to carry out data transfer between the source database and the target database in a dataflow mode, thus copying data between the source and target databases; the method and system need not to make to-be copied data as local files on the application server, so intermediate data needs not to be localized, thus solving the overloading problems of an application server disk; the method and system use the channel file to copy data, the channel file hardly occupies space, and the dataflow mode is used to transfer the to-be copied data, thus realizing high concurrency massive data copying.

Description

technical field [0001] The invention belongs to the application field of database systems, in particular to a data replication method and system based on different databases. Background technique [0002] In the current database system application environment, it is more and more common for multiple databases to coexist and use. For example, different departments of an enterprise use multiple heterogeneous or non-heterogeneous databases for information applications. Specifically, for example, department A of the enterprise uses EMC's GreenPlum database, and department B uses Oracle's ORACLE database. Department C uses Teradata database, etc. Based on this, due to the consideration of data backup and data synchronization, data replication between different databases has gradually become a problem that people are more concerned about. [0003] At present, the typical method adopted by the academic community and the industry to solve the problem of data replication between di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/27
Inventor 张永育陈守当翁世清邓波王成名汪慧柳江南赵晓莉曾楠
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com