A Lightweight Regression Network Construction Method Based on Prior Filtering

A network construction and lightweight technology, applied in the field of deep learning, can solve the problem of massive parameters, achieve the effect of small storage space, speed up network training, and reduce the amount of learnable parameters

Active Publication Date: 2021-10-08
HEFEI UNIV OF TECH
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Recently, a fixed-parameter filter network Local Binary Convolution Neural Networks (LBCnn) based on LBP ideas uses LBP-based filters, but this network uses a large number of stacked filters to improve recognition accuracy, and the parameters are still massive.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Lightweight Regression Network Construction Method Based on Prior Filtering
  • A Lightweight Regression Network Construction Method Based on Prior Filtering
  • A Lightweight Regression Network Construction Method Based on Prior Filtering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In this embodiment, the method for constructing a lightweight regression network based on prior filtering is as follows: first, perform a specified degeneration operation on each original image in the original image set, obtain the corresponding degraded image, cut the original image and the corresponding degraded image into image blocks, and obtain the training Sample pair; clustering is performed in the training sample pair, and the training sample pair is divided into different categories according to the clustering results; Ternary quantization; use the prior filter after ternary quantization to construct a lightweight regression network, the lightweight regression network includes a multi-stage filter layer, an activation function layer, and a convolution output layer; by training the lightweight regression network, the input degraded image can be reconstructed end-to-end to a higher quality image.

[0050] In the specific implementation, follow the steps below:

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for constructing a lightweight regression network based on a priori filtering. A designated degradation operation is performed on each original image in an original image set, a corresponding degraded image is obtained, the original image and the corresponding degraded image are cut into image blocks, and training is obtained. Sample pairs; perform clustering in the training sample pairs, and divide the training sample pairs into different categories according to the clustering results; Ternary quantization: A lightweight regression network is constructed and trained by using the prior filter after ternary quantization. After the training of the lightweight regression network is completed, the input degraded image can be reconstructed end-to-end to a higher quality image. The invention uses a small number of fixed a priori filters to build a network with strong pertinence but lighter weight, simple calculation, fast training speed, small required storage space, and is more suitable for small sample problems.

Description

technical field [0001] The invention relates to the field of deep learning, in particular to a method for constructing a lightweight network based on a priori filter. Background technique [0002] Deep learning is the most promising direction in the field of machine learning. It is a hierarchical machine learning method including multi-level nonlinear transformation. By constructing a network structure suitable for different tasks, it has achieved far better results than traditional algorithms. In computer vision Breakthroughs have been made in areas such as object detection, natural language processing, speech recognition, and speech analysis. With the deepening of research, while the depth and size of the deep network model are approaching the accuracy limit of computer vision tasks, its depth and size are also increasing exponentially, and its required computing consumption and hardware costs are also increasing, which limits the depth. The network is widely used on mobi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00G06T7/10G06K9/62G06N3/04
CPCG06T5/002G06T5/003G06T7/10G06T2207/20021G06T2207/20024G06T2207/20081G06N3/045G06F18/23213
Inventor 赵洋李国庆贾伟陈缘李书杰曹明伟李琳刘晓平
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products