Editing distance, word frequency and word vector based entity relation recognition method

Abstract

The invention relates to an editing distance, word frequency and word vector based entity relation recognition method which comprises the following steps: 1) acquiring text data; 2) using word segmentation software to perform word segmentation and counting the number of each word in the text; 3) adjusting the dimensions of word vectors, window size and conducting word vector training; 4) using well-trained word vectors to converge words; and 5) calculating the editing distance of the entity obtained in the fourth step, and combining the word frequency obtained in the first step to obtain the alias or the abbreviation of a given entity; based on the editing distance and the step 4, calculating the d [i, j] value of the given entity word to other entities and combining step 1 to obtain the number of each entity word; and obtaining G (X) through weighted averaging, namely, obtaining first n possible abbreviations of a given entity word and finally deciding the alias or abbreviation of the given entity word through strength of the relationship by their weight.

Description

technical field [0001] The invention relates to an entity relationship recognition method based on edit distance, word frequency and word vector, which is applied to WEB data mining, entity recognition, search engines, etc., and belongs to the technical field of data mining. Background technique [0002] In today's society, with the rapid development of science and technology, especially the development of Internet technology and the improvement of people's living standards, more and more people use the Internet, followed by the arrival of search engines, but the previous search experience is not Very good, especially for non-professionals and people who do not have many entertainment activities, what they search for in search engines is often not what they want, but this kind of thing is widely circulated among the majority of groups. The problem we face is that the purpose of the search engine’s identification of entities and the establishment of relationships is to let th...

AI Technical Summary

Problems solved by technology

[0002] In today's society, with the rapid development of science and technology, especially the development of Internet technology and the improvement of people's living standards, more and more people use the Internet, followed by the arrival of search engines, but the previous search experience is not Very good, especially for non-professionals and people who do not have many entertainment activities, what they search for in search engines is often not what they want, but this kind of thing is widely circulated among the majority of groups. The problem we face is that the purpose of the search engine’s identification of entities and the establishment of relationships is to let the system know the entity alias information retrieved by the user, and the feedback is a kind of full name information, which enhances the robustness of the system

Images