Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Convolutional neural network structure simplification and image classification method based on evolutionary strategy

A convolutional neural and network structure technology, which is applied in the field of automatic search for the optimal structure between the feature extraction part and the fully connected layer, can solve problems such as aggravating calculation pressure, reduce calculation overhead, ensure classification accuracy, and avoid The effect of good gene loss or evolutionary stagnation

Inactive Publication Date: 2019-11-08
CHONGQING UNIV OF POSTS & TELECOMM
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the other hand, there are also many model clipping algorithms that can sparse the model parameters without significantly reducing the recognition accuracy to reduce the number of parameters. However, the process of model clipping and model training is carried out simultaneously, which aggravates the Computational pressure during training

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Convolutional neural network structure simplification and image classification method based on evolutionary strategy
  • Convolutional neural network structure simplification and image classification method based on evolutionary strategy
  • Convolutional neural network structure simplification and image classification method based on evolutionary strategy

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The technical solutions in the embodiments of the present invention will be described clearly and in detail below with reference to the drawings in the embodiments of the present invention. The described embodiments are only some of the embodiments of the invention.

[0056] The technical scheme that the present invention solves the problems of the technologies described above is:

[0057] Such as figure 1 As shown, the evolutionary strategy-based convolutional neural network structure reduction and image classification method provided in this embodiment includes the following steps:

[0058] Step 1: Use the Adam optimization algorithm to update the weights, the learning rate is set to 1e-04, the optimization goal is to minimize the loss function between the predicted value and the real label, and the training set sample is used as input to pre-train a convolutional neural network model , until the model converges, save the weight of the model with the best classifica...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a convolutional neural network structure simplification and image classification method based on an evolutionary strategy. The structure between a convolution model feature extraction part and a full connection layer is simplified. The method comprises the following steps: firstly, pre-training a convolution model to fix a model weight, and performing feature extraction on an image data set by using a convolution part; then, randomly generating a plurality of binary sequences to serve as an initial population, wherein each binary sequence corresponds to a structure between a feature extraction part and a full connection layer; then, under each structure of the current population, using the pre-trained weight to classify the feature vectors of the test set, using theclassification accuracy as the fitness of the corresponding structure, obtaining a new-generation structure population through crossover, variation and selection operations, and continuously iteratingto be equal to the number of iterations; and finally, obtaining a structure between the simplified feature extraction part and the full connection layer, and performing fine adjustment on the pre-training weight by applying the structure.

Description

technical field [0001] The invention belongs to the technical field of image feature extraction and classification methods, in particular to a method for automatically searching for an optimal structure between a feature extraction part and a fully connected layer during image feature extraction and classification, and reducing the number of parameters. Background technique [0002] Convolutional neural networks (CNNs) have already occupied a place in the field of image recognition. Because of its characteristics of weight sharing, local receptive field, downsampling, and translation invariance to image features, it has good feature extraction capabilities. It can effectively reduce a large number of preprocessing processes in traditional image recognition methods, and can achieve good recognition accuracy. [0003] At present, a lot of research has been done on the convolutional neural network. Since AlexNet in 2012, a batch of classic models have been produced, such as VGG...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/00G06N3/08
CPCG06N3/006G06N3/082G06F18/214G06F18/2415
Inventor 唐贤伦徐瑾彭德光蔡军刘庆代宇艳陈瑛洁曹华军李锐
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products