Parameter deducing method, computing device and system based on potential dirichlet model

Abstract

The embodiment of the invention provides a parameter deducing method, a computing device and a system based on a potential dirichlet model, relating to the information retrieval field, and mainly for solving the problem that the solution accuracy of an LDA model is poor because of the inaccurate number of manual inputted subjects. The method comprises the steps of, according to the set initial first hyper-parameter, initial second hyper-parameter, initial subject number, initial global text, subject counting array and subject and word counting array, computing the LDA model to obtain a probability distribution; utilizing an expectation maximization algorithm to obtain the subject number, the first hyper-parameter and the second hyper-parameter making the logarithm likelihood function of the probability distribution maximal; determining whether the subject number, the first hyper-parameter and the second hyper-parameter are convergences; if yes, bringing the subject number, the first hyper-parameter and the second hyper-parameter in the LDA model to compute, until the optimal subject number, the optimal first hyper-parameter and the optimal second hyper-parameter making the logarithm likelihood function of the probability distribution maximal are convergences. The embodiment of the invention is used in text parameter deduction.

Description

technical field [0001] The invention relates to the field of information retrieval, in particular to a parameter inference method, computing device and system based on a latent Dirichlet model. Background technique [0002] With the rapid development of the Internet, the information on the Internet is increasing exponentially. Faced with such a massive amount of information resources, how to efficiently and quickly obtain the information they need is becoming more and more important to people. In order to improve the quality and efficiency of users' information retrieval, many powerful information retrieval tools-search engines have appeared one after another. While search engines bring great convenience to people, they also expose many deficiencies in the search technology with keywords as the basic index unit: on the one hand, no matter what keywords users submit, they will return too many results, among which The information that the user really needs often only accounts...

AI Technical Summary

Problems solved by technology

[0013] Embodiments of the present invention provide a parameter inference method, computing device and system based on a latent Dirichlet model to solve the problem of poor solution accuracy of the LDA model caused by inaccurate numbers of topics input manually

Images