Chinese text categorization method based on multi-hidden-layer extreme learning machine

Abstract

The invention discloses a Chinese text categorization method based on a multi-hidden-layer extreme learning machine. A regularization extreme learning machine model is applied to a Chinese text categorization problem, and text is categorized by means of a model of the multi-hidden-layer extreme learning machine. The Chinese corpus of Fudan University is used as a training set and testing set of text categorization; operation such as pre-processing is conducted on text data, including encoding mode unification, word segmentation, removal of stop words, symbols and figures and the like; the text is represented by means of a spatial vector model, and a data set is transformed into a text matrix; the text is categorized by means of the multi-hidden-layer extreme learning machine, wherein the process includes text dimensional reduction, characteristic mapping and text categorization. Text dimensional reduction is to transform high-dimensional text data into low-dimensional text data which can be calculated. The characteristics of the text are mapped by a multi-hidden-layer result of the multi-hidden-layer extreme learning machine, and high-level characteristic representation is conducted. The text is categorized by the regularization extreme learning machine of the multi-hidden-layer extreme learning machine.

Description

technical field [0001] The invention belongs to the field of natural language processing, and is a method for classifying Chinese text data through a multi-hidden layer extreme learning machine model. Background technique [0002] With the development of modern science and technology, the growth rate of human knowledge is accelerating year by year, and the cycle of information multiplication is getting shorter and shorter. The information produced by human beings in recent decades has exceeded the sum of information in the past few thousand years. Facing such a huge amount of information, how to quickly, accurately and comprehensively locate the information people need has become a new challenge. Prior to this, people used manual methods to classify texts, that is, arranged for professionals to divide texts into one or several categories according to the content. This manual method of text classification is more accurate, but it consumes a lot of manpower and material resour...

AI Technical Summary

Problems solved by technology

And the extreme learning machine autoencoder (Extreme Learning Machine Auto-Encoder, ELM-AE) in the multi-hidden extreme learning machine is used to reduce the dimensionality of high-dimensional data to solve the classification problem of high-dimensional Chinese text data

Images