A text classification method based on a bidirectional cyclic attention neural network

Abstract

The invention discloses a text classification method based on a bidirectional cyclic attention neural network, and belongs to the technical field of learning and natural language processing. The method comprises the following steps: step 1, preprocessing data; Step 2, according to the preprocessed data, generating and training a word vector of each word through a Word2vec method; Step 3, performing text semantic feature extraction on the word vector according to the word vector, fusing an attention mechanism and a bidirectional recurrent neural network, calculating the overall weight of each word, and converting the weight into an output value Y (4) of a model; And step 4, taking the feature vector Y (4) as the input of a softmax classifier according to the feature vector Y (4), and carrying out classification identification. According to the method, the attention mechanism is fused in the text feature learning model, the effect of keywords can be effectively highlighted, the performance of the model is greatly improved, and the text classification accuracy is further improved.

Description

technical field [0001] The invention belongs to the technical field of learning and natural language processing, and in particular relates to a text classification method based on a bidirectional cyclic attention neural network. Background technique [0002] In recent years, with the rapid development of the Internet, more and more information is generated, such as text, image, audio, video and other information, among which text information has the largest amount of data, so the processing of text data has become more and more More and more important, how to quickly classify these massive text data has become an urgent problem that we need to solve, which also gave birth to the generation of text classification technology. Text classification technology is intended to achieve fast and automatic classification of text information, thereby providing an effective text information classification method. [0003] The research of traditional text-based classification methods is ...

AI Technical Summary

Problems solved by technology

But the weak point of the present invention is: (1) although the text corpus of collection has been preprocessed, after text corpus is divided, just directly applied, and text corpus is not done further processing, in In the later application, the characters that are not effective for characterizing the text are likely to be disturbed; (2) the invention uses the trained emotion classification model to perform emotion classification calculations on the text corpus, but there is only one calculation, and the calculation accuracy cannot be achieved. ensure

Images