Dialogue system training data construction method and device, electronic equipment and storage medium

Abstract

The invention provides a dialogue system training data construction method, a device, electronic equipment and a storage medium, and the method comprises the steps: carrying out the statistical processing of the historical use data of the conversation system, and determining a historical query statement set corresponding to the conversation system, the query frequency corresponding to each historical query statement, and an identification result corresponding to each historical query statement; according to the query frequency and the identification result corresponding to each historical query statement, obtaining a reference query statement from the historical query statement set;judging whether the number of all reference query statements is greater than a first threshold; and if yes, constructing a training data set of the dialogue system by utilizing all the reference query statements and the identification results corresponding to all the reference query statements. Therefore, through the dialogue system training data construction method, the labor cost is saved, the construction efficiency of the training data set is improved, and the accuracy and reliability of the dialoguesystem are further improved.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a method, device, electronic equipment and storage medium for constructing training data of a dialogue system. Background technique [0002] With the development of machine learning technology, especially the rapid development of neural networks in recent years, effective training data has become more and more important, and it is even called the "data oil" of the future. The Spoken Language Understanding (SLU) task in the field of Natural Language Processing (Natural Language Processing, referred to as NLP) aims to solve the problem of semantic understanding in human-computer dialogue, and parse the spoken dialogue (query) into intent (intent) and Slots are structured data for computer processing. [0003] In related technologies, machine learning technology is a main method for realizing SLU tasks. Realizing the SLU task through machine learning technolo...

AI Technical Summary

Problems solved by technology

[0004] The dialog system training data construction method, device, electronic equipment, and storage medium proposed in this application are used to solve the problem of high cost and low efficiency in the related art of manually labeling data to construct training data

Images