Data analysis and distribution device and high-concurrency data processing method

Abstract

The embodiment of the invention discloses a data analysis and distribution device and a high-concurrency data processing method. The device comprises one or more parent threads, a cache queue manager,cache queues and sub-threads corresponding to the cache queues, the number of the cache queues is the same as that of downstream system applications corresponding to the data analysis and distribution device, and the cache queues correspond to the downstream system applications one to one. The parent thread is used for fishing to-be-processed transaction data from an upstream server side by sideand putting the to-be-processed transaction data into the cache queue. And the sub-threads are used for fishing the transaction data to be processed from the corresponding cache queues, carrying out logic processing to obtain data in a corresponding downstream system application interface format, and sending the data subjected to logic processing to the corresponding downstream system application.By utilizing each embodiment of the specification, high-concurrency data transmission between heterogeneous systems can be stably and efficiently realized.

Description

technical field [0001] The embodiments of this specification relate to the technical field of computer data processing, and in particular, relate to a data parsing and distribution device and a high-concurrency data processing method. Background technique [0002] With the continuous expansion of bank IT system functions, various heterogeneous systems are emerging, and there are more and more interactions between systems. The volume of transaction data has doubled, and the requirements for real-time transaction data processing are also getting higher and higher. . Improving hardware performance can alleviate this requirement, but considering various costs, it is impossible to increase hardware configuration indefinitely. [0003] At present, the message parsing and processing applications based on MQ middleware are basically deployed in a centralized manner on minicomputers. It is difficult to have distributed deployment, easy expansion, high performance, and dynamic config...

AI Technical Summary

Problems solved by technology

Improving hardware performance can alleviate this requirement, but considering various costs, it is impossible to increase hardware configuration indefinitely

[0003] At present, the message parsing and processing applications based on MQ middleware are basically deployed in a centralized manner on minicomputers. It is difficult to have distributed deployment, easy expansion, high performance, and dynamic configuration at the same time, and cannot effectively support traditional application systems and Efficient communication between heterogeneous systems such as big data systems

Images