Data management method and system of a centralized liquidation system

Abstract

The embodiment of the invention discloses a data management method and a data management system for a centralized clearing system. The data management method according to the embodiment of the invention comprises the following steps of acquiring message data to be written; parsing the message data to be written to obtain message relational data and message content data; storing the message relational data in an RDBMS (relational database management system) database, storing the message content data in an NoSQL (not only structured query language) database, and establishing a message content data query index in the RDBMS database; acquiring a message reading request; acquiring the message relational data and the message content data query index from the RDBMS database according to the message reading request, and querying the message content data in the NoSQL database; reading message information after the message relational data and the message content data are combined. According to the embodiment of the invention, the IO (input / output) overhead of the RDBMS database is reduced, the query cache hit ratio of the RDBMS database is increased, and the master-slave synchronization efficiency of the RDBMS database is improved; meanwhile, the size of data stored in the RDBMS database is reduced, so that the backup and restoration speed of the data in the RDBMS database is increased.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data management method and system of a centralized liquidation system. Background technique [0002] The bank's centralized clearing system connects to the SWIFT Alliance system and the local clearing interface system, and connects to the relevant business systems in the bank to centrally process foreign exchange clearing-related business messages, and realize the business goal of "one import at the head office and one export" for foreign exchange clearing. [0003] With the continuous development of foreign exchange clearing business and RMB offshore business, it is expected that the existing centralized clearing system will bear more and more processing pressure. In order to meet the needs of business development, after performing performance analysis on the existing system, it is found that the defects are mainly at the database level. There are two problems: one is the ra...

AI Technical Summary

Problems solved by technology

[0003] With the continuous development of foreign exchange clearing business and RMB offshore business, it is expected that the existing centralized clearing system will bear more and more processing pressure. In order to meet the needs of business development, after performing performance analysis on the existing system, it is found that the defects are mainly at the database level. There are two problems: one is the rapid development of business, and the bottleneck of database read and write performance is beginning to appear in the environment of large data volume and high concurrency; the other is that application development is becoming more and more complex, and there are many rules for sub-database and sub-table, and the response to demand changes is slow , the original data of the message is stored in text in the database, resulting in a huge database table, resulting in an excessively large database table, which is not convenient for archiving and further analysis of the data

[0004] At present, the database of the bank's centralized clearing system adopts two different solutions: one is to use the traditional relational database management system (RDBMS), but the RDBMS requires too much hardware, and does not support distributed storage, and cannot transparently expand nodes ; The other is to use a non-relational database (Not Only SQL, NoSQL), which has advantages that RDBMS databases do not have: low requirements on hardware, support for distributed storage, and transparent expansion of nodes. Typical NoSQL databases use key Store data in the form of -values, which has the characteristics of free mode, but with the continuous development of business and the expansion of related systems, simple NoSQL databases cannot adapt to the continuous development of business needs

Images