Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Easily-extensible configurable data backup system and method

A data backup, easy-to-expand technology, applied in database management systems, structured data retrieval, error detection of redundant data in operations, etc. Flexible time control, avoid manual errors, and realize the effect of automation

Active Publication Date: 2021-06-25
北京江融信科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In view of the above problems, an object of the present invention is to provide an easily expandable and configurable data backup system, which uses a backup database to replace the original backup files, and periodically (high frequency and small amount) expired files through migration (cleaning) of the system The data is migrated to the backup database, which solves the problem that the original migration takes a long time and the backup data cannot be directly queried; the backup database can be expanded horizontally, and the data migration (data cleaning) action can be performed between multiple physical machines and multiple data sources The system only backs up business data (non-business data does not need to be backed up), reducing the physical space occupied by the backup; data backup is flexibly configured, and the entire process of data migration (data cleaning) is executed by the program without manual intervention, realizing the automation of the data backup process and avoiding possibility of human error

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Easily-extensible configurable data backup system and method
  • Easily-extensible configurable data backup system and method
  • Easily-extensible configurable data backup system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] Such as figure 1 As shown, this embodiment discloses an easily expandable and configurable data backup system, including a management platform service module, a process processing engine module and a multi-data source service module.

[0065] The management platform service module is used to configure the relevant parameters and system parameters of data backup; provide the migration process monitoring function and monitor various indicators in the migration process; assume the role of the registration center in the service, provide service registration, service discovery and service monitoring; management The platform service module includes registration center sub-module, scheduling management sub-module, configuration center sub-module and monitoring center sub-module;

[0066] The registration center sub-module is used for unified service registration, service discovery and service monitoring functions, and the caller can discover and use the service through the reg...

Embodiment 2

[0082] Such as figure 2 As shown, this embodiment discloses an easily expandable and configurable data backup method, including the following steps:

[0083] S100: Configure system parameters, SQL parameter variables, and migrate SQL templates; when configuring migration SQL templates, when the same batch of related data is migrated, they are defined in groups to form migration groups, and each piece of data in the migration group will be Migrate the associated tables one by one in order;

[0084] Among them, the configuration of system parameters is shown in Table 1; the configuration of SQL parameter variables is shown in Table 2. When configuring SQL parameter variables, the parameters will replace the variables in the SQL template through parameter name matching to obtain actual operating parameters; the configuration of migrating SQL templates is shown in Table 3 , when configuring the migration SQL template, the SQL statement template is migrated based on the actual bu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an easily-extensible configurable data backup system and method. The system comprises a management platform service module, a flow processing engine module and a multi-data-source service module. The management platform service module is used for configuring system parameters and parameters related to data backup, providing a migration process monitoring function, and providing service registration, service discovery and service monitoring; the flow processing engine module is used for executing migration tasks based on parameters configured by the management platform service module, executing the migration tasks according to a hierarchical code sequence among migration groups, and executing the migration tasks in batches in the migration groups according to a sequence set in system parameters; and the multi-data source service module is used for performing configuration, initialization and transaction management on a plurality of data sources; The system adopts a batch processing mode to perform small-batch and multi-batch data migration, and adopts an error processing mode to ensure data migration integrity for abnormal conditions occurring in the migration process.

Description

technical field [0001] The invention relates to the technical fields of data storage and data processing, in particular to an easily expandable and configurable data backup system and method. Background technique [0002] With the continuous deepening of the digitalization of the bank's online loan business system, the continuous and stable operation of the transaction system, and the increase of time, a large amount of transaction data is generated in the transaction system and stored in the database table. The gradual increase of data will lead to the current transaction system. The response speed of inter-time business slows down, exceeding the maximum response time required by the business. The end-of-day business processing takes a long time, which will delay the normal business development on the second day. , within the bank) required to submit data caused inconvenience, and even the data was too large, resulting in insufficient temporary space, resulting in query fai...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/215G06F16/25G06F16/28G06F11/14
CPCG06F11/1448G06F11/1461G06F16/215G06F16/252G06F16/284
Inventor 衣得平
Owner 北京江融信科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products