Keyword extraction method and device and storage medium

Abstract

The invention relates to a keyword extraction method and device and a storage medium, and the method comprises the steps: receiving an original document, extracting a plurality of candidate phrases from the original document, and enabling the extracted candidate phrases to form a candidate set; obtaining the association degree between each candidate phrase in the candidate set and the original document; obtaining divergence of each candidate phrase in the candidate set; and selecting at least one candidate phrase from the candidate set as a key phrase based on the correlation degree and the divergence degree, and forming a key phrase set of the original document based on the selected at least one key phrase. Thus, the candidate phrases with the high association degree with the original document can be selected from the candidate set to serve as the key phrases, the similarity between the extracted key phrases and the original document is high, and the accuracy of extracting the key phrases is improved; the phrases with high divergence can be selected from the candidate set to serve as the key phrases, so that the difference degree between the extracted key phrases and the key phrases selected to the key phrase set is high, and the diversity of the key phrases is improved.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, and in particular to a keyword extraction method, device and storage medium. Background technique [0002] With the explosive growth of Internet text data, it is often necessary to extract keywords that can summarize the core viewpoints of articles in related businesses, so as to realize functions such as accurate recommendation and key annotation. The implementation of this type of business is highly subjective, and it is difficult to obtain available annotation corpus, which leads to low accuracy of traditional methods and consumes a lot of computing time. [0003] In related technologies, keyword extraction includes two methods, the first method is keyword extraction (for words that have appeared in the text), and the second method is keyword generation (for words that have not appeared in the text). [0004] There are many ways to implement keyword extraction in Method 1, in...

AI Technical Summary

Problems solved by technology

These two methods both rely on a large amount of labeled corpus, have high computational complexity, and are only applicable to the field of training corpus

Images