Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

A Method of Restoring Highlight Area Based on Light Field Image

A light field image and repair method technology, which is applied in image enhancement, image data processing, instruments, etc., can solve the problem of scene light information loss and other problems, and achieve the effect of improving accuracy

Active Publication Date: 2019-09-06
SHENZHEN INST OF FUTURE MEDIA TECH +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the traditional camera only records the information of one viewpoint when taking pictures, it can only focus to one depth, so most of the light information of the scene is lost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Restoring Highlight Area Based on Light Field Image
  • A Method of Restoring Highlight Area Based on Light Field Image
  • A Method of Restoring Highlight Area Based on Light Field Image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Embodiments of the present invention will be described in detail below. It should be emphasized that the following description is only exemplary and not intended to limit the scope of the invention and its application.

[0033] refer to figure 1 , in one embodiment, a method for repairing a highlight area based on a light field image proposed by the present invention, the method is as follows:

[0034] Step A1: Input a 4D light field image (can be collected by multi-viewpoint imaging equipment, such as camera array, light field camera, etc.), and the corresponding depth image

[0035] Step A2: Extract the central viewpoint image from the 4D light field image, preliminarily determine the spatial domain coordinates of the highlight target point, refocus the light field image according to the known depth image, obtain the angle domain characteristics of the highlight target point and divide it into saturated highlights Points and Unsaturated Highlights

[0036] Step A3:...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed is a specular highlight image restoration method based on multiple viewpoints, comprising: step A1: acquiring a 4D light field image and a corresponding depth image; step A2: extracting a central viewpoint image from the 4D light field image, preliminarily determining spatial domain coordinates of specular highlight target points and performing re-focusing on the 4D light field image according to an input depth image, acquiring angle domain characteristics of the specular highlight target points and dividing the specular highlight target points into saturated specular highlight points and unsaturated specular highlight points; step A3: performing intrinsic image decomposition on an image having one viewpoint or multiple viewpoints to obtain intrinsic reflection properties of the image, locating intrinsic reflection information corresponding to the specular highlight target points; step A4: restoring the unsaturated specular highlight points by means of isolating diffuse reflection components from the unsaturated specular highlight points by using local area characteristics under multiple viewpoints, and combining the same with the intrinsic reflection information determined in step A3; and step A5: restoring the saturated specular highlight points by means of disseminating the saturated specular highlight points by using diffuse reflection components of adjacent pixels and combining the same with the intrinsic reflection information determined in step A3. The method can be used to improve the quality of an image having specular highlight surfaces.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a method for repairing highlight regions based on light field images. Background technique [0002] Highlights, also known as specular reflections. In the field of computer vision and pattern recognition, the highlights of images bring difficulties and challenges to the realization of many applications. Highlight is actually a very common phenomenon in real scenes. It is the change of the color and brightness of the surface of the object caused by the change of light under different viewing angles, reflecting the optical reflection characteristics of the surface of the object. In digital images, high-light pixels often have high brightness, thus covering the color, outline, and texture of the object surface. Saturated highlights directly lead to the loss of local area information, so highlights are usually considered as image defects. At present, man...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00
CPCG06T5/005
Inventor 王好谦许晨雪王兴政方璐张永兵戴琼海
Owner SHENZHEN INST OF FUTURE MEDIA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com