Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for establishing text generation model, medium and computing equipment

A technology for generating models and texts, applied in computing, computer components, unstructured text data retrieval, etc., can solve problems such as large fluctuations and instability in model performance, and achieve quality improvement and stable training process Effect

Active Publication Date: 2019-11-05
TSINGHUA UNIV
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Later, reinforcement learning and confrontation network were used for text generation to solve this problem. Although after improvement, relatively high-quality text can be generated, but due to the instability of reinforcement learning training algorithms (such as policy gradients), the performance of the model is prone to failure. greater volatility

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for establishing text generation model, medium and computing equipment
  • Method and device for establishing text generation model, medium and computing equipment
  • Method and device for establishing text generation model, medium and computing equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the following description is exemplary only and is not intended to limit the present invention. Also, in the following description, the same reference numerals will be used to designate the same or similar components in different drawings. Different features in different embodiments described below can be combined with each other to form other embodiments within the scope of the present invention.

[0071] Combine below figure 1 To describe a method for establishing a text generation model according to an exemplary embodiment of the present invention, the method includes:

[0072] Step S110, inputting at least one training sample generated based on real data sampling into the discriminator to obtain a reward score for the training sample;

[0073] Text generation can be expressed in a formulaic language as follows: Given a real dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a method for establishing a text generation model. The method comprises the following steps: inputting at least one training sample generated based on real data sampling into a discriminator to obtain a reward score of the training sample; and training a generator based on the training sample and the reward score thereof. According to the method, the generator is trained through the training sample obtained based on the real data and the reward score output by the discriminator, so that the training process is more stable, and the quality of the generated text is remarkably improved. In addition, the embodiment of the invention provides a device for establishing the text generation model, a medium and computing equipment.

Description

technical field [0001] Embodiments of the present invention relate to the field of natural language processing, and more specifically, embodiments of the present invention relate to a method, device, medium, and computing device for establishing a text generation model. Background technique [0002] Automatic text generation is an important research direction in the field of natural language processing, and the realization of automatic text generation is also an important sign of the maturity of artificial intelligence. We look forward to the day when computers can write like humans and write high-quality natural language texts. Text generation has a wide range of applications in life, such as machine translation, intelligent question answering, dialogue systems, text summarization, and poetry creation. Using text generation, we can achieve more intelligent and natural human-computer interaction. We can also replace editors with an automatic text generation system to realiz...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/27G06F16/35G06K9/62
CPCG06F16/35G06F18/214
Inventor 黄民烈柯沛朱小燕
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com