Information retrieval method and system based on spurious correlation feedback model

Abstract

The invention provides an information retrieval method based on a spurious correlation feedback model. The information retrieval method based on the spurious correlation feedback model comprises the following steps: fusing word correlation to a spurious correlation feedback model to realize information retrieval, respectively generating a query expansion word which uses the importance degree of a candidate expansion word as a feature and a query expansion word which uses the relevancy of the candidate expansion word and the query expansion word as a feature when the query expansion word is generated in a spurious correlation document set, and then binding the two query expansion words into the original query expansion word, and finishing final information retrieval; and when generating a query expansion word which uses the relevancy of the candidate expansion word and the query expansion word as a feature, calculating the relevancy between a query word and a candidate word which appear at different positions in a document by using a kernel function. By the method, the distribution condition of the query word and the candidate word can be highlighted, the candidate word which has higher degree of correlation on query thematic words is selected, and therefore, the accurate candidate word is positioned and precision of expansion query and final retrieval is improved due to additional relevancy information.

Description

technical field [0001] The invention belongs to the technical field of information retrieval, and in particular relates to an information retrieval method and system which integrates the kernel function word correlation into a pseudo-correlation feedback model. Background technique [0002] In the age of information competition, browsing and obtaining desired information with the help of search engines is an important part of people's daily life. However, the extremely rich network resources and the rapid expansion of the total amount of information make it difficult for users to efficiently and accurately obtain and identify important information. Information processing technology urgently needs a more effective theory and method to deal with the growing mass of data. As a classic text processing technology, information retrieval can adapt to this requirement and quickly become a research hotspot in the current information processing research field. [0003] Information Re...

AI Technical Summary

Problems solved by technology

[0007] With the rapid development of the Internet and the accumulation of massive information, the accuracy of information search has become the first point of concern for all users. Now it is becoming more and more difficult to find what users want through information retrieval tools. At the same time, various information Excessive flooding makes users have to spend more time identifying which information is valuable to users

The common problem of existing information retrieval methods is that the average retrieval accuracy is not high. Even the current best retrieval model has an average accuracy of only 30%, and there is still a long way to go to improve the information retrieval accuracy.

Images