Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Test method and system for full-duplex voice interaction system

A voice interactive system and voice interactive technology, applied in voice analysis, voice recognition, software testing/debugging, etc., can solve the problem of inability to test full-duplex voice interactive systems, improve online interactive effects, reduce labor costs, Improve the effectiveness of the optimization cycle

Active Publication Date: 2021-11-26
AISPEECH CO LTD
View PDF11 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to at least solve the problem of the lack of testing methods and evaluation indicators for the overall voice interactive system in the prior art, and the inability to conduct reasonable and effective tests for the full-duplex voice interactive system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Test method and system for full-duplex voice interaction system
  • Test method and system for full-duplex voice interaction system
  • Test method and system for full-duplex voice interaction system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0050] As an implementation, the method also includes:

[0051] While playing each corpus audio in the scene mixed corpus set to the voice interaction device to be tested carrying the full-duplex voice interaction system, play a preset background to the voice interaction device to be tested carrying the full-duplex voice interaction system noise;

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a test method for a full duplex voice interaction system. The method comprises the following steps: mixing an effective corpus set related to a test scene with an invalid corpus set irrelevant to the test scene, and determining a scene mixed corpus set; playing each corpus audio in the scene mixed corpus set to a to-be-tested voice interaction device carrying the full-duplex voice interaction system; obtaining a work log of the to-be-tested voice interaction device, wherein the work log at least comprises a first log and a second log; and counting the number of logs which are expected not to output the response decision result but actually receive the response decision result in the second log to obtain the false response frequency, and determining the false response rate based on the false response frequency and the total number of the played corpus audios. The embodiment of the invention also provides a test system for the full-duplex voice interaction system. According to the embodiment of the invention, the end-to-end test of the full-duplex voice interaction system is realized, and the index aiming at the unique characteristic of full duplex is accurately obtained.

Description

technical field [0001] The invention relates to the field of intelligent voice, in particular to a testing method and system for a full-duplex voice interactive system. Background technique [0002] In order to test the performance of the voice interaction system, each module on the voice interaction link can be tested independently. For example, through the wake-up / signal processing module, test the wake-up rate, wake-up time, power consumption, etc.; through the speech recognition module, test the sentence error rate and word error rate; through the semantic understanding module, test the accuracy rate, recall rate, and analysis accuracy; The speech synthesis module is scored based on the subjective evaluation of multiple people. Most of the existing voice interaction systems use half-duplex interaction. In the half-duplex interaction, there is an absolutely orderly dependency between each module, and the entire system can complete the interaction by calling each module ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/01
CPCG10L15/01G06F11/36H04L5/0014Y02D10/00H04M3/493H04M3/527H04M3/242H04L5/14
Inventor 石韡斯樊帅宋洪博
Owner AISPEECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com