Method and device for processing batch job

Abstract

The invention discloses a method and a device for processing batch job based on a breakpoint continuous processing mechanism in one embodiment. Before the batch job, the corresponding service data table does not need to be copied; when the batch job needs to be submitted again in case of exception in the batch job, the unprocessed batch job can be executed continuously from the exception part appearing last time, and re-processing of the whole service data table is avoided. The method comprises storing the record identification information of each record to be processed at present in the service data table in the batch job process and updating the record identification information of the previous record by use of the record identification information of the next record, if the batch job is submitted again in case of exception in the batch job, determining the breakpoint record information when the exception appears according to the stored record identification information, and continuously executing the unprocessed batch job according to the breakpoint record information, wherein the record identification information is capable of uniquely identifying the corresponding record.

Description

technical field [0001] The invention relates to data processing technology, in particular to a batch processing method and device. Background technique [0002] In banking business, especially large-scale banking systems with a huge amount of data, it is often necessary to process a large amount of data in batches through batch processing operations, such as salary distribution business, withholding of industry water, electricity and coal expenses, account summary of daytime business, customer Batch generation and processing of bills, process processing of accounting report generation, etc. [0003] In the above batch processing operation process, the batch processing program needs to process tens of thousands, even hundreds of thousands, or millions of records in the business data table in sequence according to the preset order. If there is an exception in the batch job during the period, such as a certain record exception, external database exception, or insufficient memo...

AI Technical Summary

Problems solved by technology

[0004] The above method has the following disadvantages: (1), re-execute the batch job according to the backup business data table, and cannot keep the data that has been processed and updated in the last batch job, and all data in the business data table must be reprocessed. In some batch jobs with a huge amount of data, this re-execution method consumes a lot of system and is extremely inefficient; (2) Data backup of business data tables requires a lot of storage space and database resources, resulting in resource consumption Transitional consumption; (3) In the process of batch processing, the backup business data table needs to be controlled not to be updated by other jobs to ensure the correctness of the backup data. However, during the daytime online process of the banking system, a large number of online jobs are Running continuously in the background, this control is often difficult to achieve

Images