Data mining-oriented text processing system and method

Abstract

The present invention provides a data mining-oriented text processing system. The system comprises: a text extraction module, a text segmentation module, an index establishing module, an entity identification module, a keyword extraction module, an automatic summarization module, an automatic classification module and a service interface module. The text segmentation module performs code conversion, conversion between simplified and traditional Chinese, and a part-of-speech tagging operation on a text extracted by the text extraction module. The index establishing module, the entity identification module, the keyword extraction module, the automatic summarization module and the automatic classification module are used for obtaining an index file, an entity word, a keyword, an abstract and a classification result of the text content. The service interface module is used for publishing output results of the index establishing module, the entity identification module, the keyword extraction module, the automatic summarization module and the automatic classification module in the form of a service to other systems for calling. The present invention also provides a data mining-oriented text processing method. The method is capable of providing a more complete text processing capability.

Description

technical field [0001] The invention relates to the technical field of computer information processing, in particular to a data mining-oriented text processing system and method. Background technique [0002] With the rapid development and popularization of network information services and computer technology, a large amount of structured and unstructured data has emerged, especially unstructured data represented by text, etc. People are trying to extract effective, concise and , refined and understandable knowledge. Data mining generally refers to the process of automatically searching for information with special relationships hidden in a large amount of data. Data mining for text data mainly includes index building, entity recognition, keyword extraction, automatic summarization, and automatic classification. Operational procedures, and the realization of these procedures requires text processing. Therefore, a data mining-oriented text processing system needs to solve v...

AI Technical Summary

Problems solved by technology

The Chinese patent publication number is: CN103176953A, the publication date is 2013.06.26, and the patent name is: a text processing method and system, which discloses a text processing method and method for improving the efficiency and accuracy of text processing in the prior art. system, but it only involves limited text processing technologies such as text segmentation, part-of-speech tagging, and entity recognition, which limits the ability to process text

Images