Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Neural Network Model Optimization Method Based on Class Expansion Learning

A neural network model and neural network technology, applied in biological neural network models, neural learning methods, machine learning and other directions, can solve the problems of lack of migration ability, high implementation cost, and difficulty in reproduction, achieving good application value, reducing The difficulty of training, the effect of low training difficulty

Active Publication Date: 2022-04-19
ZHEJIANG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this type of optimization method has many details, high implementation cost, and difficult to reproduce; on the other hand, this type of method often designs specific evaluation indicators for specific tasks, and its evaluation indicators do not have the ability to migrate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Neural Network Model Optimization Method Based on Class Expansion Learning
  • A Neural Network Model Optimization Method Based on Class Expansion Learning
  • A Neural Network Model Optimization Method Based on Class Expansion Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0106] The following simulation experiment is carried out based on the above method. The implementation method of this embodiment is as described above, and the specific steps are not described in detail. The following only shows the results of the experiment results.

[0107]This embodiment uses three complex networks, namely ResNet-18, ResNet-32 and ResNet-110. And repeated training experiments were carried out on the three data sets CIFAR10, CIFAR100, and ImageNet-100 of image classification tasks, which proved that this method can effectively improve the optimization effect of neural networks. Among them, the parameters M=10, K=5 in the data set CIFAR10; the parameters M=100, K=10 in the data set CIFAR100; the parameters M=100, K=10 in the data set ImageNet-100. The implementation effects of the method of the present invention and the traditional neural network model optimization method on the three data sets are shown in Table 1.

[0108] Table 1 Implementation effect of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a neural network model optimization method based on class expansion learning. The specific steps are as follows: Obtain a data set containing samples of various categories for training, and define the algorithm goal; use a general model to extract the features of each type of picture in the data set, and evaluate the error-prone of each category according to the distribution of each type of feature Add the most error-prone types of data to the training pool, and use the data in the training pool to optimize the neural network; after the optimization is completed, add the remaining types of error-prone data to the training pool to expand the categories in the training pool , and use the training pool to further optimize the neural network on the basis of the neural network obtained in the previous training; continuously expand the training pool until the entire data set enters the training pool, and obtain the final optimized neural network model. The invention is applicable to the neural network model optimization based on multi-category data sets in supervised learning, and has better effect and robustness in the face of various complex situations.

Description

technical field [0001] The invention belongs to the field of computer vision, in particular to a neural network model optimization method based on class expansion learning. Background technique [0002] The optimization method of the neural network model is the underlying technology of artificial intelligence, and it is often used as the basis for high-level visual tasks, such as object detection, target recognition, semantic segmentation, etc. However, limited by computer computing resources and memory resources, current optimization methods for neural network models rely on batch stochastic gradient descent. This method is an iterative, batch-level learning model. Each training cannot use global data, but only one batch of data. Since the data for each training is usually distributed in an extremely sparse and scattered space, the optimization of the neural network model is very difficult, and it will be affected by most of the simple data while optimizing, ignoring the i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N20/00G06N3/04G06N3/08
CPCG06N20/00G06N3/04G06N3/082
Inventor 汪慧朱文武赵涵斌李玺
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products