Server and Chinese character segmentation method and device

Abstract

The invention discloses a server and a Chinese character segmentation method and device and belongs to the technical field of search engines. The Chinese character segmentation method includes: receiving a word segmentation instruction; acquiring a first Chinese character set; acquiring retrieving information corresponding to each character in the first character set according to preset corresponding relations; acquiring multiple combined characters and retrieving probabilities according to the first character set and the retrieving information corresponding to each character in the first character set; performing path combination according to the characters included in the multiple combined characters; acquiring the retrieving probability of each path; determining the path with the highest probability; performing segmentation on keywords according to the combined characters included in the path with the highest probability. Manual segmentation is omitted, independence on tools of dictionaries and the like is not needed, convenience in operation is achieved, data sources are dynamically updated, wrong segmentation modes can be rapidly corrected, high distinguishing degree is achieved for new characters, and accuracy in segmentation is improved.

Description

technical field [0001] The invention relates to the technical field of search engines, in particular to a Chinese word segmentation method, device and server. Background technique [0002] With the development of search technology and the improvement of user search needs, users may input a long keyword to be searched when performing data search. At this time, if the keyword is directly searched, the search success rate is generally very low. In order to improve the search success rate, keywords can be segmented before searching, and then the obtained word segmentation results can be searched, and the content matching the word segmentation results can be used as the keyword search results. [0003] Among them, when segmenting Chinese keywords, a machine learning method based on statistics can be used. Specifically, it includes the following steps: (1) collect text sets from data sources such as publicly issued media; (2) manually select part of the text sets for word segment...

AI Technical Summary

Problems solved by technology

[0005] Statistical-based machine learning methods consume a lot of manpower and time, and are very dependent on the results of manual word segmentation. When there are errors in manual word segmentation results, they cannot be corrected quickly; The recognition ability of machine learning methods for new words is very weak, and for word segmentation in proprietary fields, the error rate is also high

Images