A microblog information priority collection method based on multiple strategies

Abstract

The invention relates to a microblog information priority collection method based on multiple strategies, which can timely and effectively obtain the information of a blogger by constructing a multi-strategy priority collection method under the condition of limited collection capability. The method comprises the steps of firstly, constructing a classification model to screen bloggers, removing junk bloggers, and dividing the remaining bloggers into three categories according to the number of microblogs and the number of fans; secondly, aiming at different types, constructing different acquisition strategies; clustering the blog sending time of the large V bloggers, and extracting the optimal collection time of the large V bloggers; and through the microblog statistics of the bloggers, training a regression model, predicting the activity values of the bloggers, and sorting the bloggers according to the activity values; and finally, designing a multi-strategy microblog priority acquisition method by integrating the three types of acquisition strategies, and maintaining the timeliness of the acquisition strategies by periodically updating the acquisition queue. Experiments show that the hotspot microblog information can be effectively obtained in time, and the collection number is greatly increased.

Description

technical field [0001] The invention belongs to the field of text information processing, and specifically designs a method for preferentially collecting microblog information based on multiple strategies. Background technique [0002] Weibo has become one of the most important information exchange platforms in China. Daily news at home and abroad, celebrity activities, and interesting events in life will all become topics of discussion for people, so a large number of related information will be updated every day. information, these are often referred to as hotspot information. By analyzing the hotspot information on Weibo, we can effectively obtain the hotspots that netizens pay attention to. Web crawlers can effectively collect the page information of Weibo bloggers, so as to obtain hotspot information in a timely manner. However, with the huge increase of microblog bloggers and the limited collection capacity, it is difficult to collect microblog information in real ti...

AI Technical Summary

Problems solved by technology

[0005] Finally, there are a large number of potential zombie accounts or marketing accounts among Weibo bloggers, and the Weibo posts are not only insufficient in information, but also have a large number of Weibo, which wastes a lot of time in the collection process, causing normal bloggers hotspot information cannot be collected in time

Images