A Keyword Extraction Method and Device Based on Graphical Model

Abstract

The embodiment of the invention provides a method and a device for extracting a keyword based on a graph model. The method comprises the steps of acquiring a to-be-processed text, and segmenting words of the to-be-processed text to obtain candidate keywords corresponding to the to-be-processed text; finding out word vectors corresponding to the candidate keywords from a word vector model, wherein the word vector model includes the word vectors of the candidate keyword; constructing a word similarity matrix of the candidate keywords according to the word vectors; acquiring a language database corresponding to the to-be-processed text, calculating global information of the candidate keywords in the language database to obtain a global weight of the candidate keywords, and taking the global weight as an initial weight of the candidate keywords, wherein the global information represents the importance degree of the candidate keywords in the language database, and the language database at least includes a search log and a network document; and ranking the candidate keywords according to the initial weight and the word similarity matrix of the candidate keyword, and extracting the keyword of the to-be-processed text. By use of the embodiment, the keyword extraction accuracy rate is effectively improved.

Description

technical field [0001] The invention relates to the technical field of keyword extraction, in particular to a method and device for extracting keywords based on a graphical model. Background technique [0002] At present, there are various keyword extraction methods, such as semantic-based keyword extraction methods, webpage-based keyword extraction methods, etc. , this method is simpler and more direct, does not require training, and has better results, so it has been widely used. [0003] Existing keyword extraction methods based on graphical models, by dividing the text into several components (words, sentences), and establishing a graphical model, use the voting mechanism to sort the components in the text, and then select the top-ranked components unit as a keyword. Specifically, the given text is first divided into complete sentences. Then perform word segmentation and part-of-speech tagging for each sentence to obtain words and part-of-speech tags corresponding to ...

AI Technical Summary

Problems solved by technology

[0004] However, the existing keyword extraction methods based on graph models are only based on the current text. If the current text is a short text, all the words in the text appear only once, and it is impossible to determine which word is important. Therefore, each Words may be extracted, resulting in the inability to accurately extract keywords; if the current text is a long text, some words that appear many times (such as "because of", "probably", etc.), because they have votes for themselves, make their own The number of votes is too high, resulting in the importance of these repeated words, but the extraction of these words itself is meaningless, resulting in low accuracy of keyword extraction

In short, only based on the current text to extract keywords, no matter whether the current text is long text or short text, some words in the text are extracted as keywords because of scattered semantics or high frequency of occurrence, which eventually leads to keyword extraction. The accuracy rate is not high

Images