Public opinion data analysis model based on deep learning

Abstract

The invention relates to a multitask text analysis method based on text sentiment analysis of CNN-LSTM and textrank abstract automatic extraction of word2vector. The method comprises the steps of obtaining massive to-be-tested network text data, firstly, preprocessing network text data to be tested and then inputting the preprocessed network text data into an LSTM-CNN neural network; according tothe LSTM-CNN, a classical text sequence processing method being used for a long-term and short-term memory network; obtaining a vector representing the context; the CNN further extracting higher-dimensional and effective features; then, sending features into softmax to be subjected to multi-classification, so that sentiment positive and negative directions of a text are obtained, secondly, segmenting the input text data into sentences by combining a textrank algorithm based on word embedding to construct a graph model, and calculating the similarity between the sentences to serve as weights ofedges; by calculating sentence scores, sorting the obtained sentence scores in an inverted order, and extracting several sentences with the highest importance degree as candidate abstract sentences;finally, displaying the analysis result in the form of a report. The multi-task text data processing model enables a public opinion monitoring result to obtain high accuracy and high efficiency, and text analysis precision is improved by using two neural network training.

Description

technical field [0001] The invention relates to the field of network public opinion text data processing, in particular to a multi-task text data analysis method based on CNN-LSTM text sentiment analysis and word2vector textrank summary automatic extraction. Background technique [0002] Internet public opinion refers to a network method in which people discuss social hot topics through common Internet communication channels, such as news websites, Weibo, Zhihu, and Douban. It mainly has the characteristics of convenient and fast communication. . [0003] In the era of big data, online media has penetrated into people's daily life. Public opinion monitoring achieves user public opinion monitoring by using automated tools to capture massive amounts of information, sentiment classification, and news special attention, forming reports and charts to present trends. However, the existing monitoring system simply retrieves relevant information, and it is difficult to find the de...

AI Technical Summary

Problems solved by technology

However, the existing monitoring system simply retrieves relevant information, and it is difficult to discover the development trend and hot topics of public opinion events in time, and the processing efficiency of public opinion data is low.

Images