Intelligent operation and maintenance method based on deep reinforcement learning

Abstract

The invention discloses an intelligent operation and maintenance method based on deep reinforcement learning, and relates to the technical field of automatic operation and maintenance, and the method comprises the following steps: collecting data information in advance, and importing the data information into an architecture simulator through a data collector; constructing an operation and maintenance digital twin environment for data information acquired by the data acquisition unit; loading the model from the rule storage database by the reasoning service; and after an operation and maintenance event occurs, performing reasoning through reasoning service, obtaining a matched PlayBook file suitable for being used by the Ansible, and triggering an operation and maintenance action. According to the method, various operation and maintenance data are used, the training environment of deep reinforcement learning is kept consistent with the production environment, the reliability and the real-time performance are enhanced, the operation and maintenance rules are trained by adopting the deep reinforcement learning method, manpower and material resources of rule maintenance are reduced, the accuracy and the effectiveness of the operation and maintenance rules are improved. Automatic operation and maintenance rules are found intelligently, the operation and maintenance rules are updated fully automatically, and the condition of rule aging in automatic operation and maintenance is greatly reduced.

Description

technical field [0001] The present invention relates to the technical field of automated operation and maintenance, in particular to an intelligent operation and maintenance method based on deep reinforcement learning. Background technique [0002] In the past few years, operation and maintenance has moved from traditional inefficient manual operation and maintenance to automated operation and maintenance. Compared with manual operation and maintenance, which relies entirely on personal experience for operation and maintenance, automated operation and maintenance will hand over a series of rules to automation by writing Operation and maintenance tools, typical technologies such as Ansible's PlayBook and SaltStack's SLS, greatly reduce the cost of operation and maintenance through automated operation and maintenance methods. [0003] However, there are still many problems in rule-based automated operation and maintenance. The typical problem is that the rules are aging. As th...

AI Technical Summary

Problems solved by technology

[0003] However, there are still many problems in rule-based automated operation and maintenance. The typical problem is that the rules are aging. As the target business and target equipment of the operation and maintenance change, the rules of automated operation and maintenance will become aging and inapplicable. At this time, operation and maintenance personnel need to manually re-modify the rules, which is very labor-intensive.

Images