Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Ultra-light image super-resolution reconstruction method

A super-resolution reconstruction and image technology, applied in the field of computer vision, can solve the problems of insufficient light weight and high efficiency, and achieve the effect of improving efficiency, reducing the amount of calculation, and alleviating the loss of shallow information

Pending Publication Date: 2022-06-28
杭州图科智能信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Aiming at the technical problems existing in the prior art, the present invention provides an extremely lightweight image super-resolution reconstruction method, the purpose of which is to solve the problem that the prior art is not light enough and efficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ultra-light image super-resolution reconstruction method
  • Ultra-light image super-resolution reconstruction method
  • Ultra-light image super-resolution reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] Embodiment 1 provided by the present invention is an embodiment of an extremely lightweight image super-resolution reconstruction method provided by the present invention, combining figure 1 As can be seen, embodiments of the image super-resolution reconstruction method include:

[0055] Step 1. Construct the skeleton of the dense feature fusion neural network model. The skeleton of the neural network model includes multiple feature extraction modules and an attention module that are sequentially connected hierarchically.

[0056] In a possible embodiment, step 1 includes:

[0057] Step 11, fusing the features before and after each feature extraction module as the final output of the feature extraction module.

[0058] Step 12, fusing the features of all feature extraction modules and correcting the features through the attention module.

[0059] In a possible embodiment, the process of fusing the features before and after each feature extraction module of the hierarc...

Embodiment 2

[0090] Embodiment 2 provided by the present invention is a specific application embodiment of an extremely lightweight image super-resolution reconstruction method provided by the present invention, Figure 8 It is a schematic diagram of partial results of image super-resolution reconstruction provided by the embodiment of the present invention compared with the existing technology on the Urban100_x4 data set.

[0091] In order to prove the super-resolution effect of the super-resolution image obtained by using a very lightweight image super-resolution reconstruction method provided by the present invention, the method provided by the present invention, and the existing Bicubic algorithm, SRCNN algorithm, FSRCNN Algorithm, VDSR algorithm, DRCN algorithm, LapSRN algorithm, DRRN algorithm, MemNet algorithm, CARN algorithm, CARN-M algorithm, IDN algorithm, ESRN-V algorithm, IMDN algorithm, RFDN algorithm, RFDN_L algorithm. The x2, x3, and x4 super-resolution experiments were perf...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an extremely light image super-resolution reconstruction method, which effectively alleviates the problem of shallow information loss by constructing a dense feature fusion neural network skeleton. According to the invention, based on a distillation network mechanism, a multi-scale receptive field feature fusion architecture is designed, and richer and more diversified features can be extracted; for the feature extraction subunits, a feature extraction module which is more efficient and lighter is adopted, so that the efficiency of the whole network is greatly improved; according to the method, a very simple non-local module based on Hash mapping is designed, and the correlation between points is deeply mined at very low cost; in addition, spatial information, channel information and second-order information are ingeniously fused, and an attention module with better performance is obtained. The method provided by the invention is small in parameter quantity, small in calculation amount and high in precision, and exceeds all image super-resolution reconstruction methods below 800K at present.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to an extremely lightweight image super-resolution reconstruction method. Background technique [0002] Single image super-resolution aims to reconstruct a high-resolution image from a low-resolution input, but since a certain low-resolution image can be degenerated from multiple high-resolution images, it leads to uncertainty in the task and high difficulty. In order to better solve this problem, many methods based on convolutional neural networks appeared and replaced the previous traditional methods, and achieved good results. However, these methods often have a large number of parameters and expensive calculation consumption, so the lightweight super-resolution network is further proposed and studied. [0003] The early lightweight super-resolution network only used 20 layers for feature extraction, but its effect was only a little better than the traditional method. Then the l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4053G06T3/4046G06N3/08G06N3/045
Inventor 陶文兵罗京刘李漫
Owner 杭州图科智能信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products