Text similarity calculation method and device

Abstract

A method and a device for calculating text similarity are provided in that embodiment of the present invention, At first, that embodiment of the invention obtain the longest common sub-sequence of thetwo texts, and then computes the intersection and union of the vocabulary sets corresponding to the two texts, Then, the first similarity is calculated according to the obtained intersection and union, the second similarity is calculated according to the vocabulary set corresponding to the longest common subsequence and the union obtained before, and the target similarity of the two texts is calculated according to the first similarity and the second similarity. The technical scheme combines the longest common sub-sequence and each word in the text to calculate the similarity between the twotexts, which effectively improves the accuracy of text similarity calculation. Furthermore, the accurate text similarity can provide users with more accurate answers, which improves the quality of service and user experience of intelligent interaction.

Description

[0001] This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 5, 2018, the application number is 201810569749.6, and the invention title is "Text Similarity Calculation Method and Device", the entire content of which is incorporated into this application by reference . Technical field [0002] The embodiments of the present invention relate to the technical field of text processing, and more specifically, to a method and device for calculating text similarity. Background technique [0003] Chatbot is a popular application driven by big data and artificial intelligence technology. In the process of use, the user enters the chat content, that is, the user enters the question raised by the user. The chat robot automatically generates the corresponding reply according to the question entered by the user. And feedback to users. This artificial intelligence processing method can greatly improve service efficiency and user exper...

AI Technical Summary

Problems solved by technology

The problem is that each individual vocabulary cannot accurately express the original meaning of the corresponding text, which results in inaccurate similarity between the texts calculated using each vocabulary, for example, there are two texts: I like you and you Like me, the meanings of these two texts are completely different, but the vocabulary after word segmentation of the two texts is exactly the same, then the similarity of the two texts calculated by using the existing technology is 1, which is obviously inaccurate

Furthermore, since the calculation of text similarity in the prior art is not accurate enough, the replies that the chat robot pushes for the user based on the text similarity must not be accurate enough, which seriously affects the service quality of the chat robot and the user experience.

Images