Parallel batch processing method

Abstract

This invention discloses a parallel batch process method, in which, said batch unit includes at least one operation being carried out and the method includes: dividing a database table into multiple sub-areas physically and storing the data corresponding to a pre-designed region with a code name of the region in it, setting up an image list between the code names and numbers of the batch units, setting up a data access mode to limit the data sphere of the operation access of the batch units in the sphere imaged by the region code names and numbers of the units, copying the operation in the pre-designed batch unit to multiple ones to form multiple batch units and presenting said multiple batch units in parallel.

Description

Technical field [0001] The invention relates to the technical field of centralized processing of batch data, and in particular to a parallel batch processing method to improve the processing efficiency of massive data of financial institutions. Background technique [0002] With the fierce competition in the domestic financial industry, major financial institutions have embarked on the road of data concentration. Data concentration is to merge the data of tens of thousands of institutions distributed across the country and establish a unified electronic system for the whole bank. This is a major project of China's financial electronic and intensive system construction. [0003] Data concentration will bring about a revolution in information technology and management. The original data information of financial institutions was distributed on the local systems of each institution. The batch processing system of the bank included completely independent systems running in various pla...

AI Technical Summary

Problems solved by technology

However, because batch jobs can only process data serially in a logical order, they cannot make good use of sufficient system resources

[0006] In addition, after the data is centralized, when the data in the data center rapidly expands to dozens of times, the traditional serial batch processing mode can no longer meet the growing data requirements

For example, the batch processing starting at 0:00 at night often exceeds 12 hours, which cannot guarantee the bank's account processing and the generation of various business status analysis reports

Images