Data processing method and device

A data processing and data technology, applied in the field of data processing, can solve the problems of not supporting breakpoint resuming, controlling the relocation progress, needing manual duty, deactivating the system, etc., so as to reduce the pressure of data storage, improve the efficiency of segmentation, normal Stable running effect

Pending Publication Date: 2020-01-10
PEOPLE'S INSURANCE COMPANY OF CHINA
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For the migration of data in the backup table, although the Extract-Transform-Load (ETL) tool currently used is powerful, the configuration is complicated, and it does not support operations such as breakpoint resume and control of the migration progress.
In addition, there are data migration script tools, although the processing speed is fast, but the system needs to be disabled and manual monitoring is required

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with specific embodiments of the present invention and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0039] The incremental data migration scheme described in the background technology section is widely used in today's information explosion, and can effectively solve the pressure of full backup in terms of system storage, network transmission, and manual on-duty costs. In the incremental data migration process, the incremental data migrati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device. The data processing method comprises the steps that based on a target index field in a source data table of a business data production library, grouping records to be migrated into the target data table in the source data table, wherein the target data table is a backup table, corresponding to the source data table, ina business data historical library; fragmenting the records in each group from small to large according to a self-increasing field sequence to obtain a plurality of data fragments; migrating the plurality of data fragments to a target data table according to a preset migration strategy; and deleting the record corresponding to the data fragment successfully migrated to the target data table in thesource data table. According to the embodiment of the invention, the incremental data in the business data production library of the system can be efficiently migrated to the business data history library, and sufficient storage space can be timely vacated for storing the subsequently generated business data in the production library, so that the normal operation and stable performance of the system can be ensured.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data processing, and in particular, to a data processing method and device. Background technique [0002] At present, for some scenarios that need to analyze a large amount of business data, due to the characteristics of the system, the processed business data will no longer participate in the calculation, but will be stored in the backup table as historical data. [0003] As time goes by, the data in the backup table increases sharply, which will lead to a sharp decrease in data backup efficiency, which will have a certain adverse effect on system performance. Therefore, in order to ensure the normal operation and stable performance of the system, the data stored in the backup table must be migrated to the historical database to improve the backup efficiency of business data. Due to the "non-interruption" requirement of system functions, the process of data migration is require...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/215G06F16/22G06F11/14
CPCG06F16/2282G06F16/214G06F16/215G06F11/1448
Inventor 彭冲颜巍文艺
Owner PEOPLE'S INSURANCE COMPANY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap