data stream prediction method for and device

Abstract

The invention relates to a data stream prediction method and a data stream device. The data stream prediction method comprises the steps of: updating an integration model index according to sample data, wherein the integration model index is used for storing the mapping relationship between a keyword and a support vector set, the support vector in the support vector set is one of an SVM (support vector machine) classifier in the integration model; performing word segmentation to an enter text to obtain the key word of the enter text, wherein the enter text is the data stream for predicting; according to the updated integration model index, searching the support vector set containing the key word and the information of the SVM classifier in which the support vector in the support vector set is arranged; and predicting the enter text by all support vectors in the searched support vector set. The data stream prediction method and the data stream device provided by the invention perform sublinear on-line prediction based on the integration model index; and because of aggregating the support vectors according to the key word by an inverted list, the prediction is obviously accelerated.

Description

technical field [0001] The present invention relates to the communication field, in particular to a data flow prediction method and device. Background technique [0002] In recent years, with the emergence of more and more Internet services (such as Hypertext Transfer Protocol HTTP, Simple Mail Transfer Protocol SMTP, File Transfer Protocol FTP, Microsoft Network Services MSN, QQ, BT, etc.), network security is facing more and more challenges. severe. Spam, spam, pornographic websites, network attacks and other phenomena bring great troubles to people's life every day. Therefore, content filtering of data streams, as the core issue of network content security, has become a hot topic in data stream research in recent years. Since the data stream contains a large amount of text content, the focus of data stream filtering (query) is on text processing. [0003] Currently, the text matching method is adopted for data flow filtering, such as the following technical solutions: ...

AI Technical Summary

Problems solved by technology

In order to improve the accuracy of data flow content management, one possible idea is to treat data flow management as a flow classification problem and use an integrated model with high accuracy to accurately predict data flow. However, the prediction cost of existing methods increases with the The classifier scale increases linearly, so it cannot be directly applied to large-scale data stream processing

Images