Web-based text classification mining system and web-based text classification mining method

Abstract

The invention discloses a web-based text classification mining system and a web-based text classification mining method. The system mainly comprises a text pre-processing module, a word segmentation processing module and a classification algorithm module, wherein the text pre-processing module is used for automatically screening specific information from texts to be tested, pre-processing the specific information, and filtering out irrelevant information to effectively represent the texts; the word segmentation processing module is used for carrying out word segmentation on the texts, finding attributes / attributive words of each text, and making preparation for selection of characteristic words; and the classification algorithm module is used for carrying out characteristic selection to obtain an optimum characteristic sub-set, or finding corresponding probabilities according to data which is provided by a file of a training result, comparing the corresponding probabilities to obtain the type of the maximum probability, drawing a conclusion and storing the conclusion in the file finally. The system overcomes the shortcoming of conditional independence assumption of a naive Bayes algorithm by using a hypertext markup language (HTML) tag weight, improves a classifier and can improve the recall ratio and precision ratio of data mining.

Description

technical field [0001] The invention relates to information retrieval and data mining technology, in particular to a web-based text classification mining system and method. Background technique [0002] With the extensive development of computers in today's world and the maturity of database technology, the amount of data accumulated by human beings has become larger and larger, forming a situation where data is rich but knowledge is scarce. People in various fields look forward to a method that can efficiently discover useful information, that is, knowledge, from a large amount of data. Under this background, research on knowledge discovery and data mining has become a hot topic. [0003] Data mining is the process of using a variety of analytical tools to discover patterns and relationships among massive amounts of data that can be used to make predictions. Data mining involves theories and techniques in many fields such as database, artificial intelligence, machine learn...

AI Technical Summary

Problems solved by technology

It developed from data mining and faces many unprecedented problems: for example, the amount of data continues to expand, it is difficult to control in dynamic changes, data security is difficult to guarantee, and inconsistent data forms are difficult to handle uniformly, etc.

Images