Multi-type data multi-node asynchronous issuing and delay integration method

Abstract

The invention discloses a multi-type data multi-node asynchronous issuing and delay integration method, and the method comprises the following steps: S1, generating incremental deployment data in a data source server, wherein each data node server acquires incremental deployment data file content and an issuing requirement; S2, enabling the data node server to generate a corresponding configuration file; S3, sending the configuration file to each service terminal server for real-time increment and delay increment synchronous deployment; S4, judging whether the current time period is a network busy time period or a network idle time period for the delayed issuing data; S5, for the real-time issued data, judging whether the data is successfully issued, and if the data is failed to be issued, periodically and circularly detecting the failed data and the delayed data to be issued in a network idle period by the data node server until all the data are successfully issued. The utilization rate of the network in the idle period of the network is improved, and data file missing transmission caused by issuing failure is effectively prevented; and real-time data synchronous sharing and non-real-time data delay integration are realized.

Description

technical field [0001] The invention relates to a method for asynchronous delivery and delay integration of multi-type data and multi-nodes, belonging to the field of data transmission. Background technique [0002] With the rapid development of the Internet, the emergence of massive data and changes in data structures have brought huge challenges to all walks of life in terms of data processing. Data synchronization processing is an extremely common and important data processing work, which involves the synchronization process of data from one system to another. The data migration process of the data synchronization task is manually migrated at the beginning, which is not only labor-intensive, but also has limited application places. Then there is a method of using automated tools to import full data, but as the amount of data increases, this will put great pressure on the network bandwidth, and the stability is poor, and it also requires high service construction. [000...

AI Technical Summary

Problems solved by technology

However, the problem with this data synchronization method is that when the transmission fails, there will be data differences between the data source and the data destination.

[0004] However, the existing technology cannot guarantee the accuracy of real-time incremental transmission on the issue of data synchronization, and it is necessary to introduce full-scale transmission that takes up a large bandwidth to ensure the accuracy of data synchronization. As the amount of data increases, it will still affect the network bandwidth. Generate greater pressure, resulting in a waste of network bandwidth

Images