SqueezeNet based handwritten digital recognition method

A digital recognition and handwriting technology, applied in character and pattern recognition, instruments, computer parts, etc., can solve the problems of ineffective application, high network model overhead, hardware device application limitations, etc., to reduce memory and network training. The time required, the effect of speeding up the weight update rate

Inactive Publication Date: 2018-11-30
HOHAI UNIV CHANGZHOU
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the number of parameters that need to be trained in the network is too large, resulting in high recognition accuracy of CNN handwritten digits, but the required training time is long, which cannot be effectively applied in distributed training (Forrest N.Iandola et al. 2016 proposed The communication overhead of distributed data parallel training is proportional to the number of parameters in the model), and it is difficult to import the model to mobile devices and deploy it on FPGA and some embedded hardware. Jiantao Qiu et al. proposed that the model should be as small as possible The model of the model is stored on the FPGA of less than 10M, and should not let the storage bandwidth limit its storage
The AlexNet structure proposed in 2012, although the recognition accuracy of ImageNet has been improved to a certain extent, and the generalization ability of the network has also been enhanced to a certain extent. At the same time, multiple GPUs are used to accelerate the calculation of the network. The parameters have not been effectively reduced, and the network model is still too large
[0003] Nowadays, digital recognition technology has been widely used in our lives, such as license plate recognition, ID card recognition, bank bill recognition, etc., and has a good recognition effect, but due to too many network parameters and too large a network model, The overhead required by the network model is still large, and the application on hardware devices is also greatly restricted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • SqueezeNet based handwritten digital recognition method
  • SqueezeNet based handwritten digital recognition method
  • SqueezeNet based handwritten digital recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Such as figure 1 Shown, a handwritten digit recognition method based on SqueezeNet.

[0035] Step 1, preprocessing the recognized handwritten digit samples.

[0036] (1.1) Load the training set, test set and label value of handwritten digits;

[0037] (1.2) Normalize the training set and test set;

[0038] (1.3) The network input is required to be in the format of a picture, and the loaded handwritten digital samples are stored in a one-dimensional array, so the one-dimensional sample data must be reshaped to 28*28*1 before building the network The 3D matrix sample data for .

[0039] Step 2, build and initialize the SqueezeNet network model.

[0040] (2.1) Initialize the network parameters of SqueezeNet, which is divided into two steps:

[0041] (2.1.1) Set the size of the number of samples (batch_size) taken in the handwritten digital training set for each training and the number of rounds (nb_epoch) of network training, and only take batch_size samples each time...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a SqueezeNet based handwritten digital recognition method. The SqueezeNet based handwritten digital recognition method specifically comprises: (1) pre-processing recognized handwritten digital samples; (2) constructing a SqueezeNet convolutional neural network model; (3) training the SqueezeNet network model, and testing the handwritten digital samples; and (4) obtaining arecognition result. Compared with the traditional AlexNet, the SqueezeNet network model in the invention effectively reduces the total number of network parameters, and improves the accuracy of handwritten digital recognition, has the basis of model compression, and can be better applied to mobile devices, distributed training and embedded hardware.

Description

technical field [0001] The present invention designs the field of image recognition and deep learning, specifically a handwritten digit recognition method based on SqueezeNet. Background technique [0002] With the rapid development of deep learning, convolutional neural network (CNN) has been widely used in image recognition fields such as handwritten digit recognition, and has achieved excellent recognition results. However, the number of parameters that need to be trained in the network is too large, resulting in high recognition accuracy of CNN handwritten digits, but the required training time is long, which cannot be effectively applied in distributed training (Forrest N.Iandola et al. 2016 proposed The communication overhead of distributed data parallel training is proportional to the number of parameters in the model), and it is difficult to import the model to mobile devices and deploy it on FPGA and some embedded hardware. Jiantao Qiu et al. proposed that the model...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/33G06F18/24G06F18/214
Inventor 苗红霞顾倚榜齐本胜贾澜熊天宇
Owner HOHAI UNIV CHANGZHOU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products