Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Joint modeling method for spoken language understanding model and language model and dialogue method

A language model and oral understanding technology, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as ignoring training information and achieve the effect of enhancing robustness

Active Publication Date: 2018-12-07
AISPEECH CO LTD
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional neural network-based self-adaptive techniques often completely share information in the source domain by designing a mapping to the target domain, but this assumes that the shared information is all valid, ignoring the information that may exist that is not conducive to training.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Joint modeling method for spoken language understanding model and language model and dialogue method
  • Joint modeling method for spoken language understanding model and language model and dialogue method
  • Joint modeling method for spoken language understanding model and language model and dialogue method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0038] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0039] The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, progr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a joint modeling method for a spoken language understanding model and a language model, which comprises the steps of sampling a text sequence from a sample library, and transforming the text sequence into a corresponding training vector sequence; inputting the training vector sequence into a bidirectional long-short term memory network; performing joint training of the spoken language understanding model and the language model by adopting network output of the bidirectional long-short term memory network; and extracting text feature information from the training vectorsequence by adopting the bidirectional long-short term memory network for joint training of the spoken language understanding model and the language model, thereby realizing the sharing of semantic and grammatical feature information between the spoken language understanding model and the language model.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a joint modeling method for spoken language comprehension and language model, a dialogue method and a system. Background technique [0002] The traditional spoken language understanding system (Spoken Language Understanding System) and the automatic speech recognition system (Automatic Speech Recognition System) are relatively independent, and the semantic analysis is based on the 1-best recognition result solved by the language model (Language Model) in the speech recognition system. [0003] With the enhancement of computing power and the development of neural networks, multi-task joint modeling can train the network more efficiently, and can also improve the performance of each task by designing the network. Spoken language comprehension and language model have the same model input (text), and joint modeling shares semantic and grammatical information w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/02G10L15/06
CPCG10L15/02G10L15/06G10L15/063G10L2015/0631
Inventor 俞凯张慧峰朱苏樊帅
Owner AISPEECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products