Voice technology-based intelligent virtual training method for complex equipment and system

Abstract

The invention discloses a voice technology-based intelligent virtual training method for complex equipment and system, which belong to the field of virtual training. Firstly, a virtual simulation operation environment is built for the complex equipment; secondly, in combination of personnel post configuration in the training process, parallel acquisition and processing for multi-channel voice arecarried out; thirdly, in view of determined equipment operation rules, effective voice features of training staff are extracted, automatic voice recognition is realized, and matching analysis with a password text pattern in the rules is completed; fourthly, automatic voice synthesis for equipment operation information is carried out, and through task coordination between the equipment and components, synchronization of actions, voice, phenomena, prompt and other elements of virtual training is realized; and finally, according to the requirements of equipment training and use, a learning resource base, an operation rule base, an assessment result base, a virtual equipment base and a maintenance fault base for principle teaching, rule back-to-front, virtual training, task assessment and fault diagnosis are built.

Description

technical field [0001] The invention belongs to the field of virtual training, in particular to a voice technology-based intelligent virtual training method and system for complex equipment. Background technique [0002] In actual production work, operators of large and complex equipment, such as large electromechanical equipment, aerospace measurement and control systems, large precision medical systems, and complex weapons and equipment, are trained in combination with actual installation. There are many problems in this training mode, mainly in the following aspects: : (l) The training cost is high. Large-scale and complex equipment is expensive, and training is prone to wear and aging, which seriously affects the life of the equipment. At the same time, the operating costs caused by training are also high; (2) Large-scale and complex equipment installation training is affected by site climate conditions, personnel coordination, etc. (3) The failure phenomena seen in the...

AI Technical Summary

Problems solved by technology

[0002] In actual production work, operators of large and complex equipment, such as large electromechanical equipment, aerospace measurement and control systems, large precision medical systems, and complex weapons and equipment, are trained in combination with actual installation. There are many problems in this training mode, mainly in the following aspects: : (l) High training cost

Large-scale and complex equipment is expensive, and training is prone to wear and aging, which seriously affects the life of the equipment. At the same time, the operating costs caused by training are also high; (2) Large-scale and complex equipment installation training is affected by site climate conditions, personnel coordination, etc. (3) The failure phenomena seen in the actual installation training and the troubleshooting and maintenance operations that can be experienced are very limited, and it is impossible to quickly improve the operator's performance in the face of the actual installation within the limited training time. The ability to respond to installation failures; (4) There is no automatic quantitative analysis system for training results in actual installation training. Operators cannot accurately grasp the shortcomings of training in real time, and cannot improve training methods in a timely and targeted manner, thus affecting the training level

(5) During the equipment research and development stage, the R&D personnel cannot understand the operator's intuitive feelings about the use of the equipment, and cannot optimize the operation process before the product is finalized; (6) For the actual installation training of the new equipment, there is a Relatively long period, in this period, operators and users cannot touch the equipment, and cannot conduct operation training in advance, and the phenomenon of "people waiting for equipment" appears

The above documents all focus on speech recognition, synthesis technology, or speech recognition products, and do not elaborate on the specific application of speech technology in virtual training

Images