Dialogue generation method and system based on bidirectional asynchronous sequence

A sequential and asynchronous technology, applied in neural learning methods, biological neural network models, instruments, etc., can solve the problem of repeated words in output sentences, the inability of encoders to capture knowledge information, and the difficulty of probabilistic generation quality to meet the requirements of language semantics, etc. problems, to achieve the effect of improving grammar quality and avoiding invalid content

Pending Publication Date: 2022-05-13
ZHEJIANG UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the performance of the existing data-driven neural network dialogue generation model is not good, mainly due to three problems:
[0006] (2) The encoder cannot capture enough knowledge information to provide to the decoder for decoding
[0007] (3) Due to the complexity of human languages, the quality of probabilistic generation is usually difficult to meet the requirements of language semantics
This method can only identify the corresponding reply sentence for the question sentence, and the output reply sentence may cause repeated words in the output sentence because the sampling results are too similar.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dialogue generation method and system based on bidirectional asynchronous sequence
  • Dialogue generation method and system based on bidirectional asynchronous sequence
  • Dialogue generation method and system based on bidirectional asynchronous sequence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Build a knowledge question and answer library: first prepare a set of sample questions and corresponding candidate answer knowledge triples, and learn the representation of sample questions through a two-layer Bi-LSTM network: the first layer obtains the word vector of the keywords of the sample questions , to obtain the corresponding sentence vector through a simple word vector matrix link The second layer is in Compute the second layer hidden representation based on

[0049] Hidden state γ at time step t t updated to:

[0050] o t =σ(W o [ t-1 ,q t ]+b o )

[0051] gamma t =o t *tanh(C t )

[0052] Among them, γ t-1 is the hidden state at the previous moment, q t is the input word at the current moment, C t is the neuron state at the current moment, b o is a constant term.

[0053] then link each and get:

[0054]

[0055] followed by and After a maximum pooling layer processing to get and Get the sentence vector of the final input q...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dialogue generation method based on a bidirectional asynchronous sequence, and the method comprises the steps: S1, obtaining a dialogue text, recognizing a keyword in the dialogue text, and generating a word vector corresponding to the keyword; s2, generating a statement vector of the dialogue text based on the word vector obtained in the S1; s3, calculating the similarity between the statement vector of the dialogue text obtained in the S2 and a statement vector of a sample question in a knowledge question and answer library, and generating an answer set comprising a plurality of candidate answers and word vectors corresponding to the candidate answers; s4, based on the answer set generated in S3 and the corresponding word vector, obtaining an initial answer text through a bidirectional asynchronous sequence algorithm; and S5, correcting the initial answer text, and outputting a final answer text. The invention further provides a system for implementing the method. The answer text generated by the method carries more extended contents, the problem of repeated word use is avoided through the correction algorithm, and the quality of the answer text is further improved.

Description

technical field [0001] The present invention relates to the fields of artificial intelligence, neural network and natural language processing, in particular to a dialogue generation method and system based on bidirectional asynchronous sequences. Background technique [0002] Human-computer dialogue has always been a hot research field in natural language processing. Diversity and uncertainty are the key factors for a more "real" human-computer dialogue. Thanks to the development of neural networks, data-driven generative dialogue models are more flexible It shows great potential in terms of degrees of freedom and interaction. [0003] Before neural networks are widely used, the main methods of dialogue generation tasks rely on statistical methods and retrieval methods, which are not only limited to specific fields, but also require artificially set rules for guidance in most tasks. After the emergence of neural networks, especially after the widespread application of convo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/35G06F40/284G06F40/253G06N3/04G06N3/08
CPCG06F40/35G06F40/284G06F40/253G06N3/084G06N3/044
Inventor 赵亚萍曹钰陈超王勇超
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products