Classification model application and classification model training method and device

Abstract

The invention provides a classification model application and a classification model training method and device, and the method comprises the steps: obtaining a to-be-processed corpus, and convertingthe to-be-processed corpus into a word unit sequence; determining a first occurrence frequency of each keyword in a pre-constructed keyword set in the word unit sequence, and generating a first feature vector based on the first occurrence frequency corresponding to each keyword; determining a second occurrence frequency of each word in the word unit sequence in the word unit sequence, and generating a second feature vector based on the second occurrence frequency of each word and a preset inverse document frequency of each word; inputting the first feature vector into a first classification model, and outputting a first classification result of the to-be-processed corpus; and inputting the second feature vector into a second classification model, and outputting a second classification result of the to-be-processed corpus, and determining the category of the to-be-processed corpus based on the first classification result and the second classification result. By means of the method, thecorpus classification accuracy can be improved.

Description

technical field [0001] The present application relates to the field of big data technology, and in particular, relates to a classification model application, a classification model training method and a device. Background technique [0002] Natural language processing technology is an important direction in the field of computer science and artificial intelligence, which can be used to analyze and mine text to obtain more information. In some application scenarios, natural language processing technology can also be used to predict the category of text. [0003] Exemplarily, the text may be a problem ticket submitted by a research and development personnel during product testing or operation and maintenance, specifically including a title of the problem ticket, a description of the problem, and a solution. In order to facilitate subsequent research and development personnel to summarize and analyze various problems that arise, it is necessary to classify the submitted proble...

AI Technical Summary

Problems solved by technology

However, because the content recorded in the question list is relatively complex and mostly unstructured text, it is generally analyzed and sorted out manually by specialized business personnel. On the one hand, it consumes more time and labor costs, and on the other On the one hand, the accuracy of corpus classification may be low due to misoperation

Images