Concept extraction method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a concept extraction method and device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the term extraction of a to-be-extracted text according to a preset word list, obtaining a first candidate concept list, carrying out the entity linking of the to-be-extracted text according to a preset knowledge graph, and obtaining a second candidate concept list; reordering the candidate concepts in the first candidate concept list and the second candidate concept list, and obtaining a concept extraction result of the to-be-extracted text according to a reordering result, wherein the text to be extracted is an unstructured text. According to the concept extraction method and device, the electronic equipment and the storage medium provided by the embodiment of the invention, the candidate concepts obtained by performing term extraction and entity link acquisition on the to-be-extracted text are reordered, and theconcept extraction result is obtained according to the reordering result, so that under the condition of less annotation data or even no annotation data, concepts are extracted from the unstructured text more efficiently and accurately.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a concept extraction method, device, electronic equipment and storage medium. Background technique [0002] Concept, also known as scientific concept, is a term phrase used in scientific corpus to represent specific technologies and important knowledge points. For example, "binary tree" is an important concept in the computer field. [0003] Traditional concept extraction methods mainly include three categories: key phrase and term extraction, entity linking, and concept / set expansion. For key phrase and term extraction, candidate phrases are generally obtained by word segmentation and other methods, and then the candidate phrases are sorted by confidence, and the candidate phrases with higher scores are selected as the extraction results. Entity linking is the way of finding out from text the different mentions of entities existing in its background knowledge base. T...

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a concept extraction method, device, electronic equipment, and storage medium, which are used to solve the defect in the prior art that the accuracy of concept extraction results is low in the case of less labeled data, and realize More accurate concept extraction with little or no labeled data

Images