Dialogue system training data construction method, device, electronic equipment and storage medium

Abstract

This application proposes a dialogue system training data construction method, device, electronic equipment, and storage medium, wherein the method includes: performing statistical processing on the historical use data of the dialogue system, determining the historical query statement set corresponding to the dialogue system, each history The query frequency corresponding to the query statement and the identification result corresponding to each historical query statement; according to the query frequency and identification result corresponding to each historical query statement, the reference query statement is obtained from the historical query statement set; determine whether the number of all reference query statements is greater than The first threshold; if yes, use all reference query sentences and the recognition results corresponding to all reference query sentences to construct a training data set for the dialogue system. Therefore, the method for constructing the training data of the dialogue system not only saves labor cost, improves the construction efficiency of the training data set, but also further improves the accuracy and reliability of the dialogue system.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a method, device, electronic equipment and storage medium for constructing training data of a dialogue system. Background technique [0002] With the development of machine learning technology, especially the rapid development of neural networks in recent years, effective training data has become more and more important, and it is even called the "data oil" of the future. The Spoken Language Understanding (SLU) task in the field of Natural Language Processing (Natural Language Processing, referred to as NLP) aims to solve the problem of semantic understanding in human-computer dialogue, and parse the spoken dialogue (query) into intent (intent) and Slots are structured data for computer processing. [0003] In related technologies, machine learning technology is a main method for realizing SLU tasks. Realizing the SLU task through machine learning technolo...

AI Technical Summary

Problems solved by technology

[0004] The dialog system training data construction method, device, electronic equipment, and storage medium proposed in this application are used to solve the problem of high cost and low efficiency in the related art of manually labeling data to construct training data

Images