Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image restoration method based on frequency band self-adaptive restoration model

A technology of self-adaptive repair and repair method, which is applied in inference methods, image enhancement, image analysis and other directions, and can solve the problem of not being able to simultaneously reconstruct the reasonable structure and fine texture of damaged images.

Pending Publication Date: 2021-09-17
BEIJING UNIV OF TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the problem that the existing technology cannot reconstruct the reasonable structure and fine texture of the damaged image at the same time, the present invention provides an image repair method based on the frequency band adaptive repair model, the image structure generated by the method is clearer, the texture is finer, The repaired image is more realistic without obvious borders

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image restoration method based on frequency band self-adaptive restoration model
  • Image restoration method based on frequency band self-adaptive restoration model
  • Image restoration method based on frequency band self-adaptive restoration model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to describe the technical content of the present invention more clearly, further description will be given below in conjunction with specific examples:

[0054] exist figure 1 In the frame diagram of image restoration technology based on the frequency band adaptive restoration model, the damaged image is firstly divided into high-frequency sub-bands and low-frequency sub-bands using discrete wavelet transform, and different convolution blocks are used to extract deep features for the high-frequency and low-frequency sub-bands respectively. , and then splice the extracted high and low frequency subbands into the decoder. In the decoder part, the structure combining the residual block and the convolution block is used for feature recovery, and the attention mechanism is used to further extract and transfer key features, and get The multi-frequency representation of the final inpainting result, after the inverse wavelet transform, the inpainted image is obtained. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image restoration method based on a frequency band self-adaptive restoration model, which is used for solving the problem that a reasonable structure and a fine texture of a damaged image cannot be reconstructed at the same time in the prior art. On the basis of a generative adversarial network model, an encoder-decoder network structure is used as a baseline network of a generator. In order to extract deep information from a known area, features of a damaged image are decomposed into low-frequency sub-bands and high-frequency sub-bands through discrete wavelet transform (DWT), and then features of the multi-frequency sub-bands are extracted through a convolutional network; and finally, each horizontal sub-band image is reconstructed through wavelet inverse transformation, and missing region information is complemented to generate an image. The idea of separately processing the low-frequency information and the high-frequency information is beneficial to pointedly processing the structure and texture information of the image. The image structure generated by the method is clearer, the texture is finer, and the restored image is more real and has no obvious boundary.

Description

Technical field: [0001] The invention relates to the field of computer image processing, in particular to an image repair method based on a frequency band self-adaptive repair model. Background technique: [0002] Image inpainting is a fundamental task in multimedia applications and computer vision, where the goal is to generate alternative global semantic structures and local detail textures for missing regions, and ultimately produce visually realistic results. It has been widely used in multimedia fields such as image editing, restoration and synthesis. Traditional patch-based image inpainting methods search and copy the best matching patch from known regions to missing regions. This traditional image inpainting method works well on static textures, but has limited effect on textures with complex or non-repetitive structures such as faces, and is not suitable for capturing high-level semantic information. [0003] In recent years, learning-based methods have modeled ima...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06N5/04
CPCG06N5/04G06T2207/20064G06T5/00
Inventor 王瑾王琛朱青
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products