Data acquisition method and device based on distributed system and related product

Abstract

The embodiment of the invention provides a data acquisition method and device based on a distributed system and a related product. The method comprises the following steps: receiving a target service processing request sent by terminal equipment, and enabling a target service to be a service related to global control information; determining current system time when the target service processing request is received; if it is determined that the current system time is in the pure data reading period, global control information is read from a local cache corresponding to the application service node server; if it is determined that the current system time is in a data updating time period, global control information is read from the main remote storage device or the standby remote storage device, and the data updating time period is in a service low-peak time period; and processing the target service according to the global control information. Therefore, a large amount of expansion of global control information reading performance can be supported, and the performance of a distributed system is improved. And the availability requirement can be met to the greatest extent.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data processing, and in particular to a distributed system-based data acquisition method, device and related products. Background technique [0002] Since the distributed architecture can solve various problems of the centralized architecture, it is widely used in the construction of information systems on the Internet and in various industries. However, a distributed system can only satisfy two of the three characteristics of "Consistency (English: Consistency)", "Availability (English: Availability)", and "Partition Tolerance (English: Partition Tolerance)". Network failures are normal in a large-scale distributed architecture environment, so you can only choose between availability and consistency. [0003] For large-scale Internet customer-facing systems, it is particularly important to provide continuous, reliable and efficient services, often adopting an available fault-to...

AI Technical Summary

Problems solved by technology

[0006] The embodiments of the present invention provide a data acquisition method, device and related products based on a distributed system, which are used to solve the problem of accessing the distributed cache every time global control information is obtained in the prior art, which leads to the failure of the distributed cache itself and network confusion. The dynamic balance will directly affect the overall availability of the distributed system (that is, the distributed cache component is a single point of the distributed system), and the performance bottleneck of the distributed cache directly restricts the performance and scalability of the distributed system.

Images