Unstructured light field rendering method

Abstract

The invention discloses an unstructured light field rendering method. obtaining a light field sampling image, taking the sampling viewpoint position as the vertex of the basic triangular mesh, the camera parameters of the sampling viewpoint and the geometric model of the to-be-rendered scene, recording the depth value of the scene under each sampling viewpoint, splitting the sampling viewpoint triangular mesh, and generating an independent sub triangular mesh for each vertex; Recording geometric information of the scene under the to-be-rendered viewpoint; And rendering the sampling viewpoint triangular mesh set, reprojecting to the viewpoint by utilizing the geometric information, sampling the light field image, and mixing the sampling results of the viewpoints. According to the method, the influence range and weight of sampling data are determined through the triangular mesh formed by the viewpoint positions when the sampling light field is split, the scene geometric model is re-projected, bilateral filtering is carried out on light field sampling based on the depth, and therefore the scene image under any viewpoint is rendered. Light field sampling data of various sources can befully utilized, and a vivid rendering result can be generated in real time.

Description

technical field [0001] The invention relates to the technical field of graphics processing, in particular to an unstructured light field rendering method. Background technique [0002] A light field is a parametric representation of a four-dimensional light radiation field that contains both position and direction information in space, and is the totality of all light radiation functions in space. The real information of the entire space environment can be obtained at any angle and position in the space, and the image information obtained by using the light field is more comprehensive and of better quality. In an unstructured environment, the performance of surface materials is uneven, the structure and size change are irregular and unstable, and the environmental information is not fixed, unknown, and indescribable. [0003] At this stage, real-time 3D rendering uses models, textures, and materials to simulate the appearance of entities in the real world. The result lacks ...

AI Technical Summary

Problems solved by technology

[0003] At this stage, real-time 3D rendering uses models, textures, and materials to simulate the appearance of entities in the real world. The result lacks realism and cannot express complex lighting effects. In addition, although offline rendering has a better effect, it requires extremely long time

Existing light field rendering techniques require sampling positions to be evenly distributed on a surface of a fixed shape, and cannot render images of completely new viewpoint positions off the surface, and there are incorrect ghosting phenomena in light field rendering results

Images