Business data processing method and system, server and readable storage medium

Abstract

The invention relates to a business data processing method and system, a server and a readable storage medium. The method comprises the following steps that: an index server acquires original incremental service data, and performs data fragmentation on the original incremental service data to obtain incremental fragmentation service data; the index server processes the incremental fragmentation service data to obtain incremental service data with a preset data structure, and stores the incremental service data in a distributed file system HDFS; the index server updates the data version information in the target server based on the incremental service data, and sends a data version updating notification to the target server; and the target server pulls incremental service data correspondingto the updated data version information from the HDFS according to the updated data version information, and loads the incremental service data to a memory for the client to access. By adopting the method, the automation capability and the expandability of the business data processing system can be improved, and the memory resource waste can be reduced.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a business data processing method, system, server and readable storage medium. Background technique [0002] With the continuous development of business, the business data processing system needs to process more and more business data. In existing business data processing systems, business data from offline data sources needs to be manually imported into storage engines such as Redis (RemoteDictionary server, remote dictionary service) to provide online services. [0003] Take Redis as an example. Redis is an in-memory database based on memory. Redis data is stored centrally in memory. In order to avoid data loss caused by sudden downtime, RDB (Redis DataBase, the default persistence method of Redis) will periodically store data Copy a copy to memory, and then persist the copied data. [0004] However, the automation capabilities of the above business data processin...

AI Technical Summary

Problems solved by technology

[0004] However, the automation capabilities of the above business data processing systems need to be improved, and the scalability of the memory database is poor, and the persistence of the Redis storage engine will also lead to waste of memory resources, which is not conducive to the business data processing system to provide stable online services

Images