Dependence syntax model optimization method, device and equipment and readable storage medium

Abstract

The invention discloses a dependency syntax model optimization method, device and equipment and a readable storage medium, a dependency syntax model to be optimized comprises a pre-training model at the bottom layer and a dependency relationship prediction network at the upper layer, and the pre-training model is obtained by training by adopting a domain-independent text training set. The dependency syntax model optimization method comprises the following steps: performing underlying vector extraction processing on training statements in a text training set in a target domain by adopting a pre-training model to obtain word vectors corresponding to words in the training statements; and performing upper-layer prediction processing on the word vector by adopting the dependency relationship prediction network, and optimizing a processing result to optimize the dependency syntax model. According to the method, the annotation workload can be greatly reduced, the annotation cost is reduced, and the model optimization efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of natural language processing, in particular to a dependency syntax model optimization method, device, equipment and a readable storage medium. Background technique [0002] Dependency syntax is one of the key technologies in natural language processing. It is a method to reveal the syntactic structure of a language unit by analyzing the dependency relationship between components in a language unit. Dependency syntax can help other natural language processing tasks, such as anaphora resolution, semantic analysis, machine translation, information extraction, etc. The existing graph-based dependency syntax analysis method assumes that any two elements are dependent with a certain probability, uses deep learning to train a function to evaluate the subtree score, and finds the optimal spanning tree in the process of dynamic programming. Since all possibilities of the dependency tree can be considered, ...

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to provide a dependency syntax model optimization method, device, equipment and readable storage medium, aiming at the existing graph-based dependency syntax analysis method that requires a large amount of labeled data, which is difficult to label and high in cost. question

Images