Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Co-learning method of super-resolution network based on clique structure subbands in wavelet domain

A super-resolution and wavelet domain technology, applied in the field of computer vision image super-resolution restoration, can solve the problem of fuzzy high-resolution images, low peak signal-to-noise ratio and image similarity structure index, and difficult to restore the details of a single high-definition image and other problems, to achieve good quantitative indicators and solve the effect of super-resolution recovery

Active Publication Date: 2020-12-22
PEKING UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] However, these networks often tend to produce blurred and over-smoothed high-resolution images, often lacking texture details, and it is difficult to restore the details of a single high-definition image, resulting in low peak signal-to-noise ratio and low image similarity structure index

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Co-learning method of super-resolution network based on clique structure subbands in wavelet domain
  • Co-learning method of super-resolution network based on clique structure subbands in wavelet domain
  • Co-learning method of super-resolution network based on clique structure subbands in wavelet domain

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] Below in conjunction with accompanying drawing, further describe the present invention through embodiment, but do not limit the scope of the present invention in any way.

[0065] The present invention provides a method for jointly learning a super-resolution network based on group structure subbands in the wavelet domain, and constructs a novel super-resolution network: a group-type super-resolution image network; a group-type super-resolution image network includes two parts: a feature embedding network ( FEN) and Image Reconstruction Network (IRN).

[0066] (1) The overall structure of the network

[0067] like figure 1 As shown, our clique super-resolution image network mainly consists of two subnetworks: Feature Embedding Network (FEN) and Image Restoration Network (IRN). A feature embedding network represents a low-resolution input image as a set of feature maps. Note that the feature embedding network does not change the input image size (h, w), where h and w ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for learning super-resolution network based on sub-band of group structure in wavelet domain, which realizes super-resolution restoration of single picture by constructing a novel super-resolution network comprising a feature extraction network and an image restoration network. The input low-resolution image is represented as a set of feature maps by a feature extraction network. The image restoration network includes a cluster upsampling module and a convolution layer. The output features of the feature extraction network are transferred to the cluster upsampling module for sub-band extraction, self-residual learning and sub-band refinement. The inverse discrete wavelet transform is used to change the resolution of the feature image so as to recover the feature image with high resolution. Then the high resolution image is restored by convolution layer. The method of the invention has good quantization index and can effectively realize super-resolutionrestoration of a single picture.

Description

technical field [0001] The invention relates to computer vision image super-resolution restoration technology, in particular to a method for jointly learning a super-resolution network based on sub-bands of a clique structure in a wavelet domain, which can solve the problem of super-resolution restoration of a single picture. Background technique [0002] Single image super-resolution refers to reconstructing a high-resolution image from a single low-resolution image, which is an ill-posed inverse problem. For several years, there has been increasing research interest in single image super-resolution. Recently, convolutional neural networks (refs [1], [2], [3]) have significantly improved the peak signal-to-noise ratio of reconstructed high-resolution maps and real images in the single-image super-resolution problem. These networks usually first use a feature extraction module to extract a series of feature maps from a low-resolution image, and then cascade with an upsampli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T3/40
CPCG06T3/4053
Inventor 林宙辰钟之声沈天成杨一博
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products