Data increment method and device, computer equipment and storage medium

Abstract

The invention discloses a data increment method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a scene classification sample corresponding to a specific scene and a specified sample proportion, carrying out the text preprocessing of the scene classification sample through employing a regular expression, and obtaining a to-be-trained text; carrying out incremental training on the to-be-trained text by adopting the original word vector model to obtain a target word vector model; based on the actual sample number corresponding to each classification label and the total sample number corresponding to the scene classification samples, determining an actual sample proportion corresponding to the classification labels; if the actual sample proportion is smaller than the specified sample proportion, taking the scene classification sample corresponding to the classification label as a sample to be incremented; and inputting the to-be-incremented sample into the target word vector model for processing, obtaining candidate phrases corresponding to the to-be-incremented sample, randomly selecting one target synonym from each candidate phrasefor replacing the to-be-incremented sample, and obtaining a first newly added sample. The method can effectively guarantee data balance.

Description

technical field [0001] The present invention relates to the technical field of data increment, in particular to a data increment method, device, computer equipment and storage medium. Background technique [0002] In text classification scenarios, data imbalance is a very common problem. In terms of intelligent interview scenarios, most candidates will give relatively moderate or good answers to express themselves, and rarely give poor answers. . Therefore, in the process of realizing the automatic scoring of the interviewer's answers in the intelligent interview, there are usually more middle and preferred answer samples, while the deviation samples will be very few, resulting in extremely unbalanced samples, resulting in the accuracy of using this sample for model training. low rate problem. Contents of the invention [0003] Embodiments of the present invention provide a data increment method, device, computer equipment, and storage medium to solve the problem that th...

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present invention provides a data increment method, device, computer equipment and storage medium to solve the problem that the training text data used in the current text classification model training is unbalanced and the accuracy of model training cannot be guaranteed

Images