Entity Recognition and Linking System and Method Based on cn-dbpedia

Abstract

The invention discloses a CN-DBpedia-based entity recognition and linking system and method. The system includes an entity link module and an entity recognition module; the entity link module includes a synonym matching unit and an entity link unit; the entity recognition module includes a word segmenter, a word probability calculation unit and an entity discrimination unit. The invention constructs the semantic relationship between entities and words, so that the relationship with entities can be found in very few contexts. The invention integrates the entity recognition algorithm based on machine learning and the non-supervised word segmentation algorithm. It can consider the rationality of entity name division from a global point of view, and expand the vocabulary space of word segmentation, and calculate the word-forming probability of entity words with a more reasonable algorithm. The invention links first and then recognizes, so that the semantic information of the text is fully utilized during entity recognition, and better word segmentation and entity recognition are realized.

Description

technical field [0001] The invention belongs to the technical field of data services, and in particular relates to a CN-DBpedia-based entity identification and linking system and method. Background technique [0002] The advent of the era of big data has brought unprecedented data dividends to the rapid development of artificial intelligence. Under the "feeding" of big data, artificial intelligence technology has made unprecedented progress. Its progress is prominently reflected in related fields such as knowledge engineering represented by knowledge graph and machine learning represented by deep learning. As the dividends of deep learning for big data are exhausted, the ceiling of the effect of deep learning models is increasingly approaching. On the other hand, a large number of knowledge graphs continue to emerge, but these treasure houses containing a large amount of human prior knowledge have not been effectively utilized by deep learning. Integrating knowledge graph...

AI Technical Summary

Problems solved by technology

The present invention can solve the problem of entity linking with less contextual information in short texts

Images