Method for detecting similar texts on basis of text picture retrieval

Abstract

The invention discloses a method for detecting similar texts on the basis of text picture retrieval. The method includes steps of establishing document libraries; establishing text picture libraries; extracting features of pictures in the text picture libraries and reducing dimensions; segmenting retrieval documents to obtain retrieval picture sets; extracting features of pictures in the retrieval picture sets and reducing dimensions; measuring cosine similarity of the retrieval picture sets; filtering full-test similarity of retrieval results; outputting the retrieval results. The method has the advantages that diversified multilayer convolutional neural network modules are integrated with one another for training CNN (convolutional neural network) feature description operators, and accordingly text images can be deeply visually represented; the dimensions are reduced by means of PCA (principal component analysis) compression, and accordingly the similarity measurement efficiency can be improved; full-text similarity filter models are built from the filter aspect of the retrieval results, improvement can be carried out, accordingly, the similarity of the retrieval results can be updated, the retrieval precision can be improved, optional multiple character texts can be directly recommended and retrieved, and the method is excellent in similar text detection capacity and can be used for checking the repeatability of the texts or recommending similar literature.

Description

technical field [0001] The invention relates to a similar text detection method based on text picture retrieval. Background technique [0002] With the vigorous development of digital media technology, the scale of multimedia resources including text images is getting larger and larger. Text retrieval has gradually become a research hotspot in the field of natural language processing, and many text retrieval methods based on optical character recognition (OCR) technology have been produced. This method recognizes text content from images, and then uses text retrieval technology to implement text image retrieval systems. However, traditional text image retrieval systems need to rely on OCR-based complex models to achieve better text recognition and text similarity detection results. In addition, to directly recommend and retrieve unconstrained text images containing any number of characters, while adapting to different language symbols, a similarity retrieval method is neede...

AI Technical Summary

Problems solved by technology

However, in practice, it is usually difficult to improve the accuracy of similarity retrieval if only the cosine similarity between text images is calculated. For example, different text images may have similar visual features but different high-level topic features. Case

Images