Indexing equipment, indexing method, search device, search method and search system

Abstract

The invention provides indexing equipment which comprises an irregular character string segmentation module and an indexing establishment module, wherein the irregular character string segmentation module is used for segmenting an irregular character string in a document, and the indexing establishment module is used for establishing an index based on the character string obtained by being segmented and the document. Due to the fact that the technical scheme includes that the irregular character string in the document is proposed to be segmented and the new segmented character string is used as a keyword to establish the index, the indexing equipment has the advantages of being capable of reasonably controlling the length of a file list pointed by the keyword in an index structure and the length of a keyword list, namely, controlling the size of the indexing within the acceptable range of computer memory and improving indexing speed of the character string. The invention further provides an indexing method, a search device, a search method and a search system.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to an indexing device, an indexing method, a retrieval device, a retrieval method and a retrieval system. Background technique [0002] Search engines have become the main entrance of the Internet, and people query and locate Internet information resources through search engines. The traditional search engine indexing method is to use keywords to point to the inverted index of documents. In the inverted index, keywords are segmented according to natural semantics, and the segmentation rules conform to natural language habits, so the size of the keyword list is within the acceptable range of computer hardware. The general practice is to put all the keyword lists in the memory to achieve the purpose of quick access. [0003] Specifically, mainstream search engines use inverted index technology to realize fast retrieval of user retrieval requests by establishing a huge inve...

AI Technical Summary

Problems solved by technology

[0005] The first method: an irregular character string is used as a keyword, but in this case, each keyword corresponds to very few documents, and may even correspond to only one document, which causes a lot of waste of resources; The second method: a single character in an irregular string is used as a keyword. Compared with the first method, the advantage of this method is that the size of the keyword list is greatly reduced. The disadvantage is that the document pointed to by each keyword The number increases, and the amount of calculation for each non-regular string query will increase greatly, and the corresponding query speed will slow down

The above two methods have their own advantages and disadvantages. The first method uses space for time, but hardware resources will be wasted. The second method uses time for space, but it is very time-consuming to query once. Neither of them can solve irregular strings very well. indexing problem

Images