Transfer learning system and method for natural language processing task based on field adaptation

A technology of natural language processing and transfer learning, applied in natural language data processing, neural learning methods, electrical digital data processing, etc., can solve problems such as lack of training data and poor results

Active Publication Date: 2018-02-02
上海数眼科技发展有限公司
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the ambiguity of natural language and the overfitting of the model in the embedding layer will lead to poor performance of these models in the application of specific fields.
At the same time, due to the lack of training data in specific fields, it is impossible to use specific field data for training

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transfer learning system and method for natural language processing task based on field adaptation
  • Transfer learning system and method for natural language processing task based on field adaptation
  • Transfer learning system and method for natural language processing task based on field adaptation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The implementation of the present invention will be described in detail below in conjunction with the accompanying drawings and examples, so as to fully understand and implement the process of how to apply technical means to solve technical problems and achieve technical effects in the present invention. It should be noted that, as long as there is no conflict, each embodiment and each feature in each embodiment of the present invention can be combined with each other, and the formed technical solutions are all within the protection scope of the present invention.

[0074] In addition, the steps shown in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and, although a logical order is shown in the flow diagrams, in some cases, the sequence may be different. The steps shown or described are performed in the order herein.

[0075] The invention is a migration learning method based on domain-adaptive...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transfer learning system and method for a natural language processing task based on field adaptation, and the system comprises an open field part module and a specific fieldpart module. The open field part module is used for employing the existing open field data for training, and modifying an output layer according to different natural language processing tasks. Specifically, an LSTM network carries out the training of an open field, and a weight matrix of an open field neural network can be obtained. The specific field part module is used for constructing a specific field neural network, and modifying an output layer according to different natural language processing tasks, wherein the output layer is consistent with the output layer of the open field part. A neural network weight matrix of a repeated part and a trained open field neural network weight matrix remain the same, and the specific field neural network is trained, and a result of different natural language processing tasks is obtained according to the results of the output layers. The system solves a problem of field adaption in the natural language processing task.

Description

technical field [0001] The invention is a migration learning system and method for natural language processing tasks based on domain adaptation, and solves the problem of domain adaptation in natural language processing tasks. Background technique [0002] Natural Language Processing (Natural Language Processing) is a sub-discipline in the field of artificial intelligence and linguistics. Discuss how to process and use natural language in this field, including natural language cognition, natural language generation and natural language understanding. Natural language cognition refers to allowing computers to "understand" human language. Natural language generation systems convert computer data into natural language. Natural language understanding systems convert natural language into a form that can be more easily processed by computer programs. The main tasks of natural language processing include part-of-speech tagging, sentiment analysis, and syntactic analysis. [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06F40/205G06F40/284G06F40/295
Inventor 肖仰华谢晨昊梁家卿崔万云
Owner 上海数眼科技发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap