Online identification method and system for high-frequency continuous failure tasks in cloud computing system

Abstract

The invention discloses an online identification method and system for high-frequency continuous failure tasks in a cloud computing system. According to offline monitoring data, offline analysis and learning based on time series are performed to obtain a certain confidence level that can represent all non-high-frequency continuous failure tasks. The failure frequency threshold of the failure frequency feature of the failure task is then identified to obtain high-frequency continuous failure tasks in the online data. The present invention analyzes the tasks in the cloud computing system from the perspective of events and resources, obtains the frequency of failure events within a time period and the system resources consumed by the tasks, and identifies cloud computing in real time by analyzing the failure frequency characteristics of tasks and the time series pattern of resource usage. For high-frequency continuous failure tasks that fail repeatedly and are difficult to repair in the system, notify the cloud computing system in advance to take proactive failure recovery measures to save system resources for the cloud computing system and improve the reliability and availability of the cloud computing system.

Description

technical field [0001] The invention belongs to the technical field of cloud computing, and in particular relates to an online identification method and system for high-frequency continuous failure tasks in a cloud computing system. Background technique [0002] Cloud computing has been widely used in various fields such as finance and business due to its on-demand consumption mode. The high availability of the system in the cloud computing environment has increasingly become the key to the maturity of cloud computing technology. However, due to the gradual expansion of cloud computing system scale and increasing heterogeneity, various types of failures frequently occur in cloud computing systems, which has become one of the key factors that threaten the availability and reliability of cloud computing systems. In a cloud computing system, a task, as the smallest scheduling unit running on a single node, is the basic guarantee for the normal execution of user applications, an...

AI Technical Summary

Problems solved by technology

However, the existing technology does not have an effective method for identifying high-frequency continuous failure tasks

Although high-frequency continuous failure tasks will be rescheduled by the system immediately after each failure, they cannot be quickly recovered by restarting, but will fail repeatedly after repeated scheduling.

Repeated failures not only cause a lot of waste of system resources, but also increase the load of the cluster scheduler, bringing potential harm to the cloud computing system, making it difficult to meet the high availability requirements of the cloud computing system

Images