Chinese full-text searching method based on database

Abstract

The invention relates to a Chinese full-text searching method based on a database. A Chinese word segmentation module is integrated in the database, an interpreter is generated, word segmentation is performed on Chinese data to be searched, the Chinese data having undergone word segmentation and the Chinese data before the word segmentation are stored into the database, and a correlation is established; indexes are established on fields of the stored Chinese data having undergone word segmentation, searching is performed on the Chinese data having undergone word segmentation, and searching results are obtained; and through the correlation between the Chinese data having undergone word segmentation and the Chinese data before the word segmentation, the Chinese data before the word segmentation is obtained, that is, full-text searching results are obtained. According to the Chinese full-text searching method based on the database, quick full-text searching can be performed on plenty of data, and the efficiency is high. Through testing, it takes 20166.568 milliseconds for LIKE wildcard characters to perform a full-text search for 10 million data volumes, while it only takes 0.651 millisecond through the method. The method makes up for the blank of Chinese full-text search of a current mainstream database, including MySQL and PostgreSQL.

Description

technical field [0001] The present invention relates to the technical field of data identification; data representation; record carrier; record carrier processing, in particular to a database-based Chinese full-text search method. Background technique [0002] With the continuous and rapid development of Internet technology, human society has entered an unprecedented information age. Data has penetrated into every industry and business function field today and has become an important factor of production. The era of big data has come. In the era of big data, the data that people master is growing at an explosive rate. At the same time, the form of data is also undergoing fundamental changes. The storage and analysis methods of big data have become the key to processing big data. Research on how to deal with large-scale data It has become the only way to solve how people can quickly obtain effective information in the era of big data. [0003] Full-text retrieval is a very i...

AI Technical Summary

Problems solved by technology

However, existing mainstream databases, such as MySQL and PostgreSQL databases, do not support Chinese full-text search methods. At the same time, SCWS, as one of the most convenient open source and free Chinese word segmentation plug-ins, can divide a whole paragraph of Chinese characters into words, but the plug-in itself does not support the search function, only provides the function of Chinese word segmentation

Images