Distributed system-based data acquisition method and acquisition system

Abstract

The invention provides a distributed system-based data acquisition method and acquisition system. The method comprises the steps of taking nodes needed to perform data acquisition in a distributed system as acquisition nodes, and setting objects needed to perform data acquisition in the acquisition nodes as acquisition sub-items; monitoring the acquisition sub-items of the acquisition nodes by the acquisition nodes, and storing changed data items and change value marks in the acquisition sub-items; in each polling time slice, polling the acquisition nodes in sequence to obtain the changed data and the change value marks in the acquisition sub-items; and updating a distributed system database based on original acquired data in the distributed system database according to the changed data and the change value marks in the acquisition sub-items of the acquisition nodes. According to the distributed system-based data acquisition method and acquisition system, the node information monitoring overhead is reduced and the data acquisition efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to a distributed system-based data collection method and collection system. Background technique [0002] With the rapid development of distributed systems, the network structure is increasingly complex and heterogeneous, and the monitoring and analysis of the status and business data of each node in the system is becoming more and more important and more complex. The centralized monitoring system can provide administrators with the status and business information of all nodes in the system. In this ONE TO ALL mode, the monitoring system generally collects data from various nodes, and completes the sorting and processing of information locally. This mode can avoid checking each node one by one, greatly reducing the daily maintenance burden of administrators. [0003] When collecting node status and business data, you can determine whether the node status is normal by judgi...

AI Technical Summary

Problems solved by technology

However, the disadvantage of this method is: when the node information changes very frequently, once the information changes, it will be immediately transmitted to the collection system through the network, and in the case of inconsistency in the environment and business, the processing of predicting the collection time is increased overhead, and may introduce more random errors; at the same time, the implementation and maintenance of the acquisition system are more complex and costly

[0015] Therefore, in the case where the requirements for real-time performance are not particularly strict, and the collection items usually need to be changed flexibly, none of the existing data collection methods can effectively improve the efficiency of data collection.

Images