A batch data conflict detection method, device and system

Abstract

The invention provides a batch data conflict detection method, a batch data conflict detection device and a system. The method comprises the steps of receiving data information of a to-be-processed task inputted by a user; storing the data information into a to-be-processed queue according to a task sequence number corresponding to the data information; reading a piece of the data information from the to-be-processed queue and acquiring state information of the read data information, information of an occurred task and data of a conflict relation between two objects; judging whether the to-be-processed task is conflicted according to the state information of the read data information, the information of the occurred task and the data of the conflict relation between the two objects; if yes, judging whether the conflict frequency of the to-be-processed task reaches an upper limit; if yes, setting the state of the to-be-processed task into failure, if no, adding one to the conflict frequency of the task to be processed, and adjusting the to-be-processed task to the tail of the to-be-processed queue.

Description

technical field [0001] The invention relates to batch data processing technology, in particular to a batch data conflict detection method, device and system. Background technique [0002] In large-scale online data processing systems (such as bank data processing systems and enterprise data processing systems), with the increasingly complex data processing scenarios and the increasing data processing volume, many systems conduct large-scale data processing online (in the case of some banks Take the intermediary business data processing system as an example, including batch enterprise annuity payment, batch establishment of individual accounts, batch adjustment of account affairs, etc.) facing many difficulties. When these large-scale data processing is processed by the system, the data volume is large and the verification and processing logic are complex. Online real-time processing may cause a large system overhead on the system, resulting in a decrease in the overall respo...

AI Technical Summary

Problems solved by technology

However, in this mode, a new problem is encountered: since the temporary batch is transferred during the day, and the system is also providing external services at the same time, how to solve the tasks processed when the temporary batch is transferred and the external service of the online system The tasks that occur do not create a conflict and become a subject to be resolved

2. When the object or an object that has a certain relationship with the object is in a certain state, the object cannot perform a certain type of task

3. When the system is running the evening batch, objects related to the batch job cannot process certain types of tasks

Images