Text clustering multi-document automatic abstracting method and system for improving word vector model

Abstract

The invention discloses a text clustering multi-document automatic abstracting method and a system for improving a word vector model. The CBOW of the Hierachic Softmax belongs to the field of large-scale model training, and the CBOW of the Hierachic Softmax belongs to the field of large-scale model training. Based on the method, a TesorFlow deep learning framework is introduced into word vector model training; the problem of time efficiency of a large-scale training set is solved through streaming processing calculation, TF-IDF is introduced firstly during sentence vector representation, thenthe semantic similarity of a semantic unit to be extracted is calculated, weighting parameters are set for comprehensive consideration, and a semantic weighted sentence vector is generated; beneficialeffects are as follows. The advantages and disadvantages of semantics, deep learning and machine learning are comprehensively considered; density clustering and convolutional neural network algorithms are applied. Intelligent degree is high, according to the method, the statement with high relevancy with the central content can be quickly extracted to serve as the abstract of the text, various machine learning algorithms are applied to the automatic text abstract to achieve a better abstract effect, the method is possibly the main research direction in future in the field, and in addition, the system according to the invention supplies a tool for automatic extraction of a document abstract based on the method.

Description

technical field [0001] The invention relates to the field of natural language processing, in particular to a text clustering multi-document automatic summarization method and system for improving word vector models. Background technique [0002] The Internet belongs to the field of media. Also known as the International Network, the Internet began in 1969 with the Arpanet in the United States. It is a huge network connected in series between networks. These networks are connected by a set of common protocols to form a logically single huge international network. Generally, the internet generally refers to the Internet, while the Internet refers to the Internet in particular. This method of interconnecting computer networks can be called "network interconnection". On this basis, a global Internet covering the whole world is developed called the Internet, which is a network structure that is interconnected. The Internet is not the same as the World Wide Web. The World Wide ...

AI Technical Summary

Problems solved by technology

[0004] However, the related technologies of sentence fusion, sentence compression and language generation are not yet mature enough, resulting in grammatical errors, logical incoherence, or blunt contextual cohesion in the generated summaries.

Images