Automatic abstract generation method based on concept semantic unit

Abstract

The invention relates to an automatic abstract generation method based on a concept semantic unit. The method comprises the steps that the concept semantic unit is utilized to serve as a carrier of semantic computation and document content representation; a semantic focus of document content is obtained through convergence of document semantic content; automatic generation of a document abstract formed by selecting abstract sentences representing the document content according to the semantic focus is achieved. According to the automatic abstract generation method based on the concept semantic unit, by means of a potential Latent Dirichlet Allocation (LDA) mode, modeling is conducted on a document theme, theme generation treatment is achieved, and the abstract sentences are selected according to the importance degree of the theme. In the computation process, a concept hierarchy network symbol is introduced, merging to semantic information is achieved by means of semantic hierarchy relations in the concept hierarchy network symbol, and the data sparsity problem caused by taking a word as a semantic computation unit is improved.

Description

technical field [0001] The invention relates to the field of intelligent analysis of natural language texts, in particular to an abstract automatic generation method based on conceptual semantic primitives. Background technique [0002] With the rapid development of information technology, the Internet has entered people's daily life. The bottleneck of information transmission has been broken, and people can easily access massive amounts of information content. How to quickly understand the content of information has become the current development direction of intelligent information processing and a hot spot in technical research. Especially with the rapid expansion of document information on the Internet, facing a large amount of document information, users urgently need tools that can effectively process these document information. Automatic text summarization, based on natural language processing technology, is an intelligent text processing application technology that...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem that the calculation of sentence weight value based on word frequency cannot well reflect the deep semantic content of the document described in the background technology, and at the same time improve the topic analysis method with words as the statistical processing unit applied to a single document and the data is sparse questions, and then form the abstract content of a single document

Images