Automatic webpage classification method based on network hot word identification

Abstract

The invention relates to an automatic webpage classification method based on network hot word identification. The automatic webpage classification method mainly comprises the following steps of: acquiring webpage content information by using customization crawlers, and automatically performing word classification on acquired webpage contents through an Internet keyword base and an Internet stopword base; calculating a hot value according to a keyword appearance frequency and a time distance degree, and performing initial classification on the webpage contents according to the hot value of the words through a Bayesian multidimensional classification model; performing relevance identification on non-matched word classification items in classified webpages through a relevance algorithm, and finding out non-collected hot words from the Internet keyword base, and collecting the non-collected hot words into the Internet keyword base; and reclassifying the webpage contents which cannot be classified in an initial webpage classification process through an updated Internet word base.

Description

technical field [0001] The invention relates to a method for automatically classifying webpages, in particular to a method for automatically classifying webpages based on network hot word recognition, which belongs to the technical field of data mining. Background technique [0002] With the rapid development of the Internet and Web technology, the number of web pages on the Internet is constantly increasing. The increasing popularity of the Internet and the explosive growth of the number of Internet users have resulted in complex and diverse network behaviors. In order to effectively organize and analyze massive web information resources and help users quickly obtain the knowledge and information they need, it is necessary to automatically classify web pages. [0003] There are two main types of traditional text classification methods: one is the classification method based on statistics, and the other is the classification method based on knowledge. The idea of ​​the clas...

AI Technical Summary

Problems solved by technology

Compared with the classification method based on statistics, the advantage of this method is that it can obtain higher classification accuracy when classifying texts, but the disadvantage is that more manual review steps are often needed to be added in the process of updating the thesaurus, and the The response to newly emerging hot words on the Internet is relatively lagging

Images