A noisy illegal short text recognition method based on a dual-channel text convolutional neural network

Abstract

The invention relates to a noisy illegal short text recognition method based on a dual-channel text convolutional neural network. The method comprises the steps of preprocessing the short texts with noise, constructing a dual-channel text convolutional neural network model, and training and real-time recognizing the model. The preprocessing of the short text with noise is used for standardizing the noise characters, eliminating the influence of noise and improving the learning ability of the convolutional neural network model. The dual-channel text convolutional neural network model is a textconvolutional neural network model capable of inputting a preprocessed character sequence and a preprocessed pinyin sequence at the same time. Due to the fact that the input capacity and the modelingcapacity of the pinyin sequence are improved, the influence of homophone character replacement on the classification performance can be eliminated through the model. According to the method, influences caused by homophone character replacement, English character replacement with similar shapes, numeric symbol replacement with the same semantics and the like can be processed, and the experimental results show that the method has higher recognition accuracy and lower false detection rate for the recognition of the illegal short texts with noise.

Description

technical field [0001] The invention belongs to the field of computer natural language processing, and relates to a method for identifying illegal short texts with noise based on a double-channel text convolutional neural network. Background technique [0002] With the rapid development of the network, the sharing and communication of information and opinions through the network has become an important way of current network applications. For example, discuss certain issues through BBS; express views, news and comments through Weibo; communicate through instant messaging tools; comment on the comment pages of news websites; communicate through live video services; Comment on the video content through the barrage when the video is playing, etc. This mode of user-generated content facilitates information sharing and communication among users. However, this method of publishing Internet content is also easy to be used by criminals to release some illegal advertising informati...

AI Technical Summary

Problems solved by technology

However, the method of constructing rules to extract variant features is easy to be identified by illegal users, so as to further evade the identification of the system by updating the generation method of variants

In addition, artificially constructing variant features is a relatively difficult task

Images