A real-time reading and updating method for slow system data based on multi-user large data volume

Abstract

The invention relates to a real-time reading and updating method for slow system data based on multi-user large data volume, the steps are: 1. Each client requests a fixed number of pieces of data from the server each time, and reads it once every fixed time ;2. The client parses the data and saves the ID of the unfinished data; 3. The client judges the current number of unfinished data. If it does not exceed the maximum number limit, execute step 5. Otherwise, read and update in batches For unfinished data, execute step 4; 4. Group unfinished data into groups, and add a group every time the maximum number exceeds the limit; 5. Request the latest status of unfinished data from the server at regular intervals; 6. According to steps 1~ 5. Read and update data continuously. If the reading is completed, reduce the time interval for requesting unfinished data in 5. 7. Repeat steps 1 to 6 to continuously read and update data. Compared with the prior art, the present invention has the advantages of being fast and effective, ensuring state updating and the like.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for real-time reading and updating of slow system data based on multi-user large data volume. Background technique [0002] Data is an unavoidable problem in system design, and data transmission is flooded in all aspects of the system. In the Internet era, people can obtain faster data transmission through faster physical transmission channels, better data protocols, and more streamlined data structures. However, the accompanying cost increase, even in pursuit of the ultimate transmission speed, the cost is increased geometrically. However, in more cases, users just need a simple multi-client data transfer function that can guarantee performance without exorbitant cost. [0003] HTTP is a simple request-response protocol, which usually runs on top of TCP, and is a reliable way to transfer data. However, its weaknesses in transmitting data are also more obvious...

AI Technical Summary

Problems solved by technology

[0004] However, if each client reads all the data at one time, and then continues to update a large number of data, it will inevitably cause huge pressure on the server

Once the number of clients exceeds the load of the server, each client needs to wait in line for a data response. Not only can the data not be obtained in real time, but it will require a long waiting time in the queue, and even cause the server to crash in severe cases.

In addition, since the status of the data obtained by the client is updated in real time, if the status needs to be updated, the data must be pulled again, resulting in a large waste of data bandwidth and increasing the congestion of the data channel

Images