Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Natural language task processing method and device combining regular expression and neural network

A natural language and neural network technology, applied in the field of natural language task processing, can solve the problem of scarcity of training data

Pending Publication Date: 2020-03-24
PEKING UNIV
View PDF2 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in practical problems, especially when opening up new fields, we often encounter the problem of scarcity of training data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language task processing method and device combining regular expression and neural network
  • Natural language task processing method and device combining regular expression and neural network
  • Natural language task processing method and device combining regular expression and neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. It should be understood that the described embodiments are only some of the embodiments of the present invention, not all of them. example. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0050] The example of the invention includes two typical tasks in the field of natural language processing spoken language comprehension: intent recognition and slot analysis. Intent recognition is a typical sentence classification task. It is necessary to learn a function mapping to input sentences containing n words x=[x 1 ,...,x n ] is mapped to its corresponding intent label c. Slot parsing is usually regarded as a typical seq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a natural language task processing method and device combining a regular expression and a neural network model. The method comprises the following steps of: 1) giving a task related to a natural language, and acquiring domain knowledge in a regular expression form for a specific domain related to the task to obtain a regular expression set; 2) selecting a basic neural network model capable of solving the task for the task; and 3) introducing domain knowledge contained in the regular expression set in the training process of the neural network model, thereby improving the performance of the neural network model for the task. The combination of the regular expression and the neural network model can be carried out on different levels, including an input layer, a module layer and an output layer. According to the method, the specific module of the neural network model can be finely adjusted based on the domain knowledge in the regular expression form, and the training of the neural network is assisted, so that the performance of the neural network model on the task is improved.

Description

technical field [0001] The invention belongs to the field of natural language processing, and relates to a natural language task processing method and device combining regular expressions and neural networks. In the process of neural network training, relevant domain knowledge is gradually learned from regular expressions, thereby improving the performance of the model on related tasks. Background technique [0002] With the development of machine learning and artificial intelligence technology, people's demand for a large amount of labeled data is getting higher and higher. However, the cost of obtaining labeled data is very expensive. How to effectively use domain knowledge to assist the training of neural networks, thereby reducing the The demand for a large amount of labeled data has become a very important issue. [0003] Regular expression is a technology widely used in natural language processing related tasks, and its application areas include pattern matching, sent...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/04G06F16/35
CPCG06F16/35G06N3/044G06N3/045
Inventor 叶元罗炳峰冯岩松贾爱霞赵东岩
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com