Emergent topic detecting method and system facing text streams of micro-blog platform

Abstract

The invention provides an emergent topic detecting method and system facing text streams of a micro-blog platform. The method comprises the following steps that (1) user data and user generation information data of the micro-blog platform are collected in real time, and information text and images are extracted; (2) a time window is set, the information text is divided, and real-time data streams and historical data are obtained; (3) characteristics are selected, and training of a popularity evaluation model and a long micro-blog extraction model is carried out; (4) popularity evaluation is carried out on the real-time data streams by means of the popularity evaluation model, long micro-blog extraction is carried out on the real-time data streams by means of the long micro-blog extraction model, the information which is evaluated to be popular is put into popular information sets, and extracted long micro-blog contents are put into long micro-blog sets; (5) whether the number of the popular information sets and the number of the long micro-blog sets achieve preset threshold values is judged, if yes, topic extraction is carried out through an LDA model or in a weighting summation mode, emergent topics are extracted from data of the popular information sets and the long micro-blog sets, if no, the method goes back to the step (1).

Description

technical field [0001] The invention relates to the field of Internet information management, in particular to a sudden topic detection method for microblog platform text flow. Background technique [0002] With the rapid development of the Internet, especially the rapid development of Web2.0, social networking services represented by Facebook, Myspace and Twitter have become indispensable communication tools for network users. These social network services provide users with functions including updated information of friends, updated information of interested persons or groups, and related information of the latest popular times, and these functions are gradually changing the information acquisition methods of users of social network services. As a new type of social network, microblog, represented by foreign Twitter and domestic Sina Weibo, is quite different from Facebook and other virtual communities based on traditional communities. On the real-time nature of the news....

AI Technical Summary

Problems solved by technology

However, the topic model has problems such as inflexible parameter setting, noise in real-time text streams, and insufficient statistical information, etc., and the topics it discovers are not necessarily sudden topics or events.

Images