Incremental data migration method capable of realizing breakpoint transmission

Abstract

The invention relates to an incremental data migration method capable of realizing breakpoint transmission. The method provided by the invention is similar to the method for realizing the breakpoint transmission of file transmission and is realized by taking a table object and a record as units. When a migration process is re-executed due to a migration failure caused by conditions such as system halt, power failure, network disconnection, system or application program crash and the like in the data migration process, a migration tool based on the incremental data migration method can automatically identify finished and unfinished migration tasks, and start continuing migration from a breakpoint. The migration method capable of realizing the breakpoint transmission mainly comprises two aspects, namely migration-plan-based migration interruption state storage and migration interruption state recovery. By the data migration method, the effectiveness and continuity of migration of each time can be ensured; when the migration is interrupted, incremental migration can be performed on the basis of the conventional migration task when the same migration task is re-executed, so that unnecessary data repeated migration can be avoided; in addition, the complex operation of manually identifying the breakpoint and manually regulating the migration task can be avoided, and data migration efficiency is greatly improved; and particularly, migration continuity, reliability and high efficiency are strongly ensured in the migration of massive data.

Description

technical field [0001] The invention relates to the data migration technology of a database system, in particular to an incremental data migration method for realizing a breakpoint resume transmission mechanism. Background technique [0002] With the development of enterprise informatization, the original database system may not meet the current needs of the enterprise, and the old database system needs to be converted to a new database system, usually a heterogeneous database system. In order to effectively utilize the historical data of the old system, various objects in the old database, especially table objects and data need to be transplanted to another target database. This inevitably involves the data migration of the database system. Data migration refers to migrating data from a source database to a target database between different databases. The quality and efficiency of migration is often an important prerequisite for the successful launch of the new system, an...

AI Technical Summary

Problems solved by technology

This leads to a long time-consuming migration process, and the possibility of abnormal conditions such as network interruptions and system or application crashes greatly increases during the process. In case of these abnormal conditions, the migration is interrupted, and the user or the entire migration is re-migrated Once, the previous migration results are overwritten, resulting in the waste of the previous migration; or the user manually screens out the migration tasks that have not been completed, and changes the scope of the next migration task. For massive databases, manual screening tasks are time-consuming and laborious, and the probability of errors increases. , the correctness cannot be guaranteed

[0007] 2. Some methods and tools take into account the situation of migration interruption and breakpoint resume, but the solution is too simple and has great limitations

In case of changes, such as between the interrupted migration and the resuming migration, the user inserts a new row in the destination table, this method is no longer applicable

[0012] Third: Failure to consider and not applicable to other database objects such as indexes and sequences

For example, for tables with a large amount of data, the establishment of indexes may also take a long time. If the migration is interrupted, this method cannot determine which indexes have been established and which have not been established. If you want to get the answer, you may need to manually Finding the target library or migration log is time-consuming and laborious, reducing the migration efficiency

Images