Global-local adaptive optimization panoramic light field splicing method

Abstract

The invention discloses a panoramic light field splicing method based on global local adaptive optimization. The panoramic light field splicing method comprises the following steps: inputting a plurality of light fields to be spliced; extracting, matching and screening feature points of the to-be-spliced light fields to calculate a global homography transformation matrix of all the to-be-spliced light fields; respectively carrying out 4D meshing on the plurality of to-be-spliced light fields, evaluating the global registration precision of each grid according to the global homography transformation matrix, calculating a local homography transformation matrix of the grid of which the global registration precision is lower than a preset threshold, and evaluating the local registration precision of the corresponding grid according to the local homography transformation matrix; and comparing the global registration precision with the local registration precision, taking the homography transformation matrix with the highest precision for each grid, and fusing the light fields to obtain a splicing result. According to the invention, the overall and detail splicing results of the light field are most accurate, so that an accurate multi-light-field panoramic splicing method is realized.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a global-local adaptive optimization panoramic light field splicing method. Background technique [0002] The microlens array between the main lens and the sensor of the light field camera can effectively capture light information, and simultaneously record the direction and intensity information of light in one shot. Therefore, the light field can accurately reproduce the stereoscopic parallax, motion parallax, reflection, refraction, refocusing and other effects in the scene, provide users with a very realistic and immersive experience, and provide a great boost to the research in the field of virtual reality. However, limited by the optical structure of the light field camera, its field of view is small, and in order to benefit from the great potential of the light field, it is necessary to expand the field of view of the light field. The panoramic...

AI Technical Summary

Problems solved by technology

However, the existing panoramic light field stitching algorithms usually have dislocation and ghosting problems caused by parallax, resulting in inaccurate stitching results.

Images