Vertical search engine system and method using semantic analysis

Abstract

The invention discloses a vertical search engine system and a method using semantic analysis. The system comprises a text semantic analysis module, an indexing system module and a retrieval system module, wherein the text semantic analysis module extracts a context attribute which is represented by each sentence in a text by using the sentence as a unit, and segments and marks the context attribute; the context attribute integrates occurrence frequency of words, concept attributes of the words and the semantic statuses of the words in the sentence; the indexing system module individually establishes an index for each type of context attributes; and during retrieval, different context attributes can be retrieved independently or retrieved together. The invention has the advantages that: language environments of the words are represented by the context attributes, so the limitation of the language environments can be increased during the retrieval, and a retrieval result has better relevancy. The invention is particularly applied to enterprise search and vertical search which are relevant to the fields of search engine systems, and also applied to processing of mass dark web data by a general search engine.

Description

technical field [0001] The invention relates to a search engine system, more specifically, to a semantic analysis technology, and a vertical search engine system and method realized by using the semantic analysis technology. Background technique [0002] Search engines have become an important means for people to obtain information, and now they have replaced portals as the first choice for people to access the Internet. [0003] Currently, the technologies used by search engines are basically based on full-text retrieval. The general principle is to use the technology of inverted files to index the text to be searched, and then use the retrieval technology of keyword matching to return the content containing relevant keywords to the user from the index database. Keyword retrieval technology generally uses statistical information such as word frequency to calculate the correlation between documents and keywords in the index database, and then provides documents containing t...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a vertical search engine system and method using semantic analysis to solve the problem that the existing search engine technology is still at the word level and grammatical level, or for a certain aspect of semantics, sentences have not been considered, or even The pitfalls of the impact of a wider semantic context on search

Images