Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Depth-based light field splicing method

A depth and light field technology, applied in the field of depth-based light field stitching, can solve problems such as ghosting and result dislocation, and achieve the effect of expanding the viewing angle, improving flexibility, and accurate large parallax light field stitching.

Active Publication Date: 2018-11-30
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF12 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the above technical problems, the present invention proposes a depth-based light field stitching method, which solves the problem of dislocation and ghosting of results caused by large parallax changes, and realizes an accurate parallax-tolerant light field stitching method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth-based light field splicing method
  • Depth-based light field splicing method
  • Depth-based light field splicing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below with reference to the accompanying drawings and in combination with preferred embodiments.

[0028] like figure 1 As shown, the preferred embodiment of the present invention discloses a depth-based light field stitching method, including the following steps:

[0029] A1: Input the light field to be spliced ​​and the sub-aperture image of the light field, and estimate the depth of the light field on the sub-aperture image of the light field to obtain the depth map of the light field;

[0030] Specifically, the light field to be spliced ​​is input, decoded and preprocessed to obtain a sub-aperture image of the light field; and the depth map of the light field is obtained by estimating the depth of the light field on the sub-aperture image of the light field.

[0031] In this embodiment, taking the splicing of two light fields as an example, L r (x,y,u,v) is the reference light field, L w (x, y, u, v) is the light fi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a depth-based light field splicing method. The depth-based light field splicing method comprises: inputting a light field to be spliced and a sub-aperture image of the light field, and estimating a light field depth of the sub-aperture image of the light field to obtain a depth map of the light field; extracting feature points in the sub-aperture image of the light field, matching the feature points to obtain feature point pairs, and screening the feature point pairs to obtain matching feature point pairs; performing 4D meshing on the light field to be spliced, and predicting a global homography transformation matrix according to the matching feature point pairs; establishing a weight matrix according to the depth and position relationship between the feature pointsand center points of the meshes; and predicting the optimal homography transformation matrix of each mesh according to the global homography transformation matrix and the weight matrix, mapping the light field according to the optimal homography transformation matrix of each mesh in the light field, fusing the light field, and obtaining a light filed splicing result. The invention solves the problem of dislocation and ghosting caused by large parallax changes, and realizes a precise parallax-tolerant light field splicing method.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a depth-based light field splicing method. Background technique [0002] Light field imaging records light information from all directions by adding a microlens array between the main lens and the sensor, so as to obtain a complete information optical radiation field. With the continuous increase in the resolution of optical sensors and the gradual marketization of light field cameras, the practical value of light field imaging technology is becoming higher and higher. Compared with the traditional digital camera, the light field camera based on the microlens array can record the spatial position information and direction information of the three-dimensional scene at the same time, so the light field data collected by the light field camera based on the light field camera has a wide range of applications, such as refocusing , depth estimation, signifi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T7/33G06T7/162G06K9/62
CPCG06T3/4038G06T7/162G06T7/337G06T2207/20221G06T2207/10052G06F18/23213
Inventor 金欣王培戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com