Visual text information discovery method and device based on multilevel cooccurrence relationship word graph

Abstract

The invention provides a visual text information discovery method based on a multilevel cooccurrence relationship word graph. The method comprises the following steps that: extracting the text contents of a document, and segmenting the text contents to obtain text segments; segmenting the text segments, extracting a keyword, and labeling a word category tag; according to the cooccurrence relationship of the keyword in the text segments, constructing the multilevel cooccurrence relationship word graph, wherein nodes in the graph correspond to the keyword, and an edge in the graph corresponds tokeyword co-occurrence constructing a word-document inverted index for each keyword in the graph for retrieving a document which contains the keyword; and through the cooccurrence relationship word graph, obtaining the visual text information. The invention also provides a visual text information discovery system based on the multilevel cooccurrence relationship word graph. The system comprises adocument preprocessing module, a keyword extraction module, a multilevel word graph construction module, a word-document index construction module and a visual information discovery module.

Description

technical field [0001] The invention belongs to the fields of text mining and natural language processing, and relates to a method and system for discovering visual text information based on a multi-level co-occurrence relationship word graph. Background technique [0002] With the development of the Internet and office electronics, text information has shown an explosive growth trend, and the amount of text generated has surpassed any previous era. On the one hand, texts contain a lot of valuable information, on the other hand, massive texts significantly increase the discovery cost of effective information. For the vast majority of applications (such as publishing, research, and supervision), it is impossible for users to read every document in the collected documents to find effective information. How to use computers to assist in mining valuable information from massive texts ( Text mining) has become an important problem to be solved urgently. [0003] According to th...

AI Technical Summary

Problems solved by technology

[0004] At present, there are three problems in the "exploratory" information discovery method: first, the efficiency of manual inspection of search results is low, and manual browsing of documents (search results) is a very time-consuming process, and the target information cannot be quickly located; second, the entire process lacks The global control of the target document collection causes users to often fall into the problem of not knowing where to come from and where to go during the discovery process, and the state of information inspection cannot be recovered and effectively used in the next inspection; Checked documents are filtered, it is difficult to avoid double checking

Images