Automatic construction technology for predicting next sentence model based on BERT model

Abstract

The invention discloses an automatic construction technology for predicting a next sentence model based on a BERT model. The method comprises test atlas data acquisition and natural language inferencemodel construction training and prediction, a test atlas data acquisition part can be connected with an atlas database to automatically acquire data with specified relations in all APPs related to acertain field. The invention relates to the technical field of natural language processing. According to the automatic construction technology for predicting a next sentence model based on a BERT model, through applying a natural language reasoning technology in deep learning to the field of APP testing, a node pair with a next sentence relationship in the graph database is automatically obtained,and the node pair is automatically processed and converted into training data required for predicting a next sentence of model. The BERT-based prediction next sentence model is used for realizing automatic reasoning and assisting in completing automatic construction of the map, so that the working efficiency is improved, and compared with other natural language reasoning models, the BERT-based prediction next sentence model has higher prediction accuracy.

Description

technical field [0001] The invention relates to the technical field of natural language processing, in particular to a BERT model-based automatic construction technology for predicting the next sentence model. Background technique [0002] In the current period, natural language processing technology based on deep learning has been widely used in various scenarios to assist humans in understanding and processing natural language and text. Typical application scenarios include text classification, dialogue systems, question answering systems, text translation and natural language processing. Language reasoning, as an important part of natural language understanding, natural language reasoning plays an important role in the entire natural language understanding. Natural language reasoning is mainly to judge the semantic relationship between two sentences or two words. In order to ensure the model Being able to focus on semantic understanding, the task eventually degenerates in...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the deficiencies of the existing technology, the present invention provides an automatic construction technology for predicting the next sentence model based on the BERT model, which solves the problem that the gradient disappears or explodes when using the cyclic neural network in the traditional solution, and the calculation itself cannot be parallelized. Slower, less accurate problem

Images