A fault detection and fault tolerance method and system for real-time cloud platform

Abstract

The invention relates to a failure detection and fault tolerance method and a failure detection and fault tolerance system for a real-time cloud platform. The system comprises a client used for sending a command, summiting a task and storing tasks assigned to working nodes in corresponding paths, a global state monitoring module used for monitoring the operation state of the working nodes, carrying out node-level failure detection and fault tolerance according to heartbeat information uploaded by the working nodes and performing migration of a task in a failure node, a global state storage module used for storing the working state and heartbeat information of the global state monitoring module and the working nodes, and working nodes used for performing a task, running a daemon process to guard a work process and performing program-level failure detection and fault tolerance. State information of a whole cluster is all stored in a Zookeeper system, a stateless architecture of the nodes is realized, a node failure does not cause state loss, the system has a perfect failure detection and fault tolerance mechanism, multilevel fault tolerance is realized, and uninterrupted operation of real-time services is guaranteed.

Description

technical field [0001] The invention relates to the field of real-time cloud computing, in particular to a fault detection and fault tolerance method and system for a real-time cloud platform. Background technique [0002] With the rise of technologies such as cloud computing and the Internet of Things, data is growing and accumulating at an unprecedented rate, and more and more appear in applications in the form of large-scale and continuous streams. The most typical application It is monitoring applications, such as financial market monitoring, network monitoring, mobile object monitoring, intrusion detection, and ecosystem monitoring. Real-time applications have higher requirements for fault detection, recovery, and fault tolerance. [0003] For this reason, many data stream processing systems have been developed in industry and academia, including Stanford University's STREAM, Xerox's Tapestry, University of California, Berkeley's Telegraph, Brown University and MIT's Au...

AI Technical Summary

Problems solved by technology

[0005] 1. It is impossible to completely overcome the state loss when the node fails. Usually, the state information, configuration information, business program files, etc. are saved on the node. Once the node fails, the state information will be lost

[0006] 2. It is impossible to completely eliminate the dependence on the master node

For example, in twitter storm, although the working node can still run when the master node fails, most functions will fail, such as submitting tasks, fault detection, etc.

[0007] 3. There is a lack of a comprehensive and overall fault detection and fault tolerance mechanism, so that both program-level and node-level faults can be detected and repaired in time

Images