Part-of-speech and self-attention mechanism fused sentiment tendency classification method and system

Abstract

The invention relates to a part-of-speech and self-attention mechanism fused emotion tendency classification method and system, and belongs to the technical field of natural language processing. The method comprises the following steps of S1, preprocessing a text, performing part-of-speech tagging while performing word segmentation, and removing stop words and useless characters; S2, performing vector representation on the preprocessed text; S3, learning semantic features of the text by utilizing a Transformer-Encoder model; S4, fusing part-of-speech attention to mine modification and matchingrelationships among words in sentences, and learning deeper emotion features; and S5, splicing the learned semantic features and sentiment features as final text features for sentiment tendency classification. Text features are learned based on a self-attention mechanism and part-of-speech attention is fused to expand emotion information to acquire richer emotion features. The feature expressioncapacity of the emotion tendency classification method is improved, and the classification accuracy is effectively improved.

Description

technical field [0001] The invention belongs to the technical field of natural language processing, and relates to an emotional tendency classification method and system integrating part-of-speech and self-attention mechanism. Background technique [0002] With the rapid development and popularization of Internet technology, the demand for network content management, monitoring and harmful (or junk) information filtering is increasing. How to effectively analyze and deal with emotionally subjective texts in network information More and more attention. Sentiment orientation classification is to divide the text into two or several types of praise or derogation according to the meaning and emotional information expressed in the text, and it is the division of the author's tendency, viewpoint, and attitude. [0003] Since the emotional tendency classification can solve the disorderly phenomenon of various comment information on the Internet to a certain extent, it is convenient...

AI Technical Summary

Problems solved by technology

[0006] In view of this, the purpose of the present invention is to provide an emotional tendency classification method and system that integrates part-of-speech and self-attention mechanism, and overcomes the shortcomings of existing methods that ignore other features that contain emotional information in the text and have insufficient feature expression ability

Images