Microblog information filtering method based on multi-information fusion

Abstract

The invention provides a microblog information filtering method based on multi-information fusion, which belongs to the technical field of intelligent information processing. The method comprises the following steps of step 1, building distributed crawling, and crawling microblog data; step 2, preprocessing the microblog data; step 3, carrying out Chinese word segmentation on the microblog data, deleting stop words, acquiring a word segmentation result, and obtaining a word set VOC; step 4, extracting characteristics from the perspective of microblog contents; step 5, extracting microblog characteristics from the perspective of the client; step 6, extracting characteristics from a transmission path; step 7, building a classification model, and screening non-junk microblogs. According to the microblog information filtering method based on multi-information fusion, the double processes of microblog information duplicate removal and a classification learning algorithm are combined to delete microblog junk information, so that the microblog information can be filtered, and not only is reduplicative microblog information filtered, but also junk microblog information can be filtered.

Description

technical field [0001] The invention belongs to the technical field of intelligent information processing, and in particular relates to a microblog information filtering method based on fusion of various information. Background technique [0002] Microblog, as a new communication carrier, contains a large number of users' microblog information on people, events, etc., so it plays an important role in the initiation and dissemination of Internet public opinion, and has become one of the important data sources for Internet public opinion browsing and analysis. one. However, in the microblog space, the convenient "forwarding" operation and the rapidly growing "network army" make a large amount of the same or similar data spread rapidly in the microblog space. At the same time, noise microblogging, as a means of publicity, has rapidly spread to every corner of the microblogging space. For the analysis of network public opinion, noisy microblogs are usually meaningless, and the...

AI Technical Summary

Problems solved by technology

Considering the dissemination, user correlation, and time correlation of microblog, the existing information filtering methods for text content itself are not enough to meet the requirements of microblog information filtering.

Images