Neural network training method and device

A neural network training and neural network technology, applied in the field of neural network training methods and devices, can solve problems such as poor performance, poor generalization ability, and lack of understanding of models

Pending Publication Date: 2021-05-18
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of research and practice of related technologies, the inventors of the present application found that in the training process of the deep neural network model, the problem of over-fitting often easily oc

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network training method and device
  • Neural network training method and device
  • Neural network training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of this application.

[0066] Embodiments of the present application provide a neural network training method and device. Specifically, the embodiment of the present application provides a neural network training apparatus suitable for computer equipment. Wherein, the computer device may be a device such as a terminal or a server, and the terminal may be a device such as a mobile phone, a tablet computer, or a notebook computer. The server can be a single server or a server cluster composed of multiple servers.

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a neural network training method and device. According to the embodiment of the invention, the method includes: obtaining a native neural network with a to-be-determined connection relationship wherein the native neural network comprises at least two network layers, and each network layer comprises at least one training node; acquiring node connection strategy information of a current training node in a current network layer; determining a target connection node corresponding to the current training node from the training nodes of the target network layer based on the node connection strategy information; establishing a connection relationship between the current training node and the target connection node to obtain a connected neural network; performing forward transmission on the sample data in the connected neural network to obtain a prediction output result; and based on the prediction output result, updating weight information of each training node in the connected neural network so as to determine the trained neural network. According to the scheme, the efficiency of neural network training can be improved, and the over-fitting phenomenon in neural network training can be improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a neural network training method and device. Background technique [0002] The artificial neural network can abstract the human brain neuron network from the perspective of information processing to build a model and form different networks according to different connection methods. For example, it can form a deep neural network including multiple hidden layers. With the continuous in-depth research on artificial neural networks, people have made great progress in various fields. [0003] In the process of research and practice of related technologies, the inventors of the present application found that in the training process of the deep neural network model, the problem of over-fitting often easily occurs, resulting in the model performing well on the training set, but in the test The performance on the set is poor, so that the trained model does not understand the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06N3/04
CPCG06N3/084G06N3/045
Inventor 王敏刘畅
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap