Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A variable block image inpainting method based on saliency map

A repair method and block image technology, which is applied in image enhancement, image data processing, instruments, etc., can solve problems including too much structural information, can not fully consider local texture characteristics, unfavorable repair, etc., and achieve the effect of alleviating the problem of greed

Active Publication Date: 2017-01-11
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods are limited by two points: the greediness of their repair and the influence of block size selection on the repair effect
Although there have been some methods based on global optimality trying to solve its greediness, the results show that these methods only alleviate its greediness, and at the same time bring a lot of computational complexity
Similarly, on the issue of block size selection, if the block selection is too small, the local texture characteristics cannot be fully considered. If the block selection is too large, it may cause the block to contain too much structural information, which is not conducive to restoration.
At the same time, blocks that are too large are also susceptible to parallax and small-angle rotation
The general method is to artificially select the block size that can contain the largest resolvable texture in the known area, and in many cases the same block size cannot meet the requirements of all unknown area repairs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A variable block image inpainting method based on saliency map
  • A variable block image inpainting method based on saliency map
  • A variable block image inpainting method based on saliency map

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The saliency map-based variable block image restoration method of the present invention will be described in detail below with reference to the accompanying drawings and examples.

[0033] refer to figure 1 , the variable block image inpainting method based on the saliency map includes the following steps:

[0034] 1), Input the image to be repaired to generate a known area saliency map, such as figure 2 (a) shows the original image before restoration, Ω represents the unknown area, and Φ represents the known area.

[0035] (11), feature extraction: first represent the image to be repaired as a 9-layer Gaussian pyramid. The 0th layer is the input image, and the 1st to 8th layers are the images formed by filtering and sampling the input image with a 5*5 Gaussian filter respectively, and the sizes are 1 / 2 to 1 / 256 of the input image respectively. Then extract various features for each layer of the pyramid: brightness I, red R, green G, blue B, yellow Y and direction O...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A variable-block image repair method based on a saliency map comprises the steps that (1) a selective attention model simulating a living body visual attention mechanism is used for generating the saliency map of an image to be repaired; (2) items of credibility, structural information and saliency in blocks are calculated and the repair priorities are obtained, wherein each point on the boundary of an unknown region serves as the center of the corresponding block; the block of which the point with the highest priority serves as the center is used as the block to be repaired; (3) according to pixel mean value changes, gradient changes and saliency changes around the block to be repaired, the size of the block is adjusted; (4) a known region is searched for the most matched block to fill pixels in the block to be repaired; credibility and saliency of the repaired pixels are updated; the step (2) to the step (4) are cycled until the image is repaired. According to the method, saliency information of the image to be repaired is used for improving the priority of repair, so that the problem of avarice of traditional repair is greatly solved; meanwhile, the size of the block can be adjusted according to the surroundings of a region to be repaired and different repair requirements are met.

Description

technical field [0001] The invention belongs to the fields of computer vision and computer graphics, and in particular relates to a variable block image restoration method based on a saliency map. [0002] technical background [0003] Image inpainting technology has a wide range of applications, mainly including damaged photo restoration and digital visual effects. Due to various factors such as storage conditions or man-made, some works of art or old photos with extremely high collection value and historical value have cracks and scratches. Therefore, it is of great significance to restore these cultural relics and data. Through digital image repair technology, only need to determine the area to be repaired, the computer can repair it according to the specified algorithm, avoiding a lot of time spent on manual repair. At the same time, applications in the field of digital visual effects production and virtual reality mainly involve object removal and scene editing. Specif...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00
Inventor 王好谦李政芝戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products