A scoring processing method and system based on lucene fragmentation structure

Abstract

The invention discloses a scoring processing method and system based on a Lucene fragmentation structure, including splitting the data of an index file to form fragmentation data of the index file, and then dividing it into each fragmentation processor to complete the initialization work; search processing The device receives the query information input by the user, performs word segmentation processing on the query information, and forms a search term; searches in the global information buffer according to the search term in turn, whether there is relevant information about the search term; if not, directly The search term is sent to each slice processor for processing; if it exists, the search processor first obtains the global information of the search term from the global information buffer, and then sends it to each slice processor for processing. The present invention processes the global information through multiple requests, so that each slice shares the global information, solves the problem of inconsistency of scores calculated by the same term in different slices, and makes the ordering of search results more reasonable.

Description

technical field [0001] The invention belongs to the technical field of mass data processing, and in particular relates to a scoring processing method and system based on a Lucene fragmentation structure. Background technique [0002] With the rapid development of the Internet and the rapid growth of Internet information, people have increasingly relied on the Internet to obtain information in their daily work and life, so how to quickly find the information they need is self-evident for people. The traditional relational database retrieval method can no longer support the retrieval of such a large amount of data on the Internet, so full-text search has emerged as a query method with a large amount of data, and the full-text search tool represented by Lucene is based on its The advantages of high efficiency, high accuracy, and high expansion are increasingly used by Internet companies. [0003] However, due to the ease of use of Lucene, it has certain disadvantages when proc...

AI Technical Summary

Problems solved by technology

[0019] Aiming at how to coordinate the scoring among the various fragments in the distributed search, this patent proposes a scoring processing method and system based on the Lucene fragmentation structure, which processes the global information through multiple requests so that each fragment can share the global information and solve the problem of Solved the problem of inconsistent scores calculated by the same term in different shards, making the ranking of search results more reasonable

Images