Moving object multi-view light and shadow synthesizing method based on sparse light field elements

A technology of moving objects and synthesis methods, which is applied in the fields of computer vision and virtual reality, can solve the problems of high price and difficulty of popularization of ultra-high-speed cameras, achieve the requirements of reducing acquisition time and storage space, simplify and optimize layout and combination, and ensure accuracy Effect

Active Publication Date: 2015-09-16
BEIHANG UNIV
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this technology requires an ultra-high-speed camera to complete the data collection of various viewing angles and lighting conditions under a "relatively still" obje...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Moving object multi-view light and shadow synthesizing method based on sparse light field elements
  • Moving object multi-view light and shadow synthesizing method based on sparse light field elements
  • Moving object multi-view light and shadow synthesizing method based on sparse light field elements

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0019] refer to figure 1 Overall architecture diagram of the present invention, the present invention comprises 5 steps:

[0020] (1) Obtain the scene illumination radiation map. refer to figure 2 The method for obtaining the radiation map of the high dynamic scene, firstly, from a main perspective and an auxiliary perspective, take photos of the photosphere sequence placed in the scene with three different exposure times. The image with the centered exposure time of each viewing angle is selected as the reference image, and the other two images are compared with the reference image to obtain their respective relative offsets and aligned to the reference image. The present invention utilizes the image pyramid to improve the registration effect, and defines two images I 1 with I 2 The degree of difference is:

[0021] E d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a moving object multi-view light and shadow synthesizing method based on sparse light field elements. Light distribution of a light field data acquisition system is set according to the illumination radiation diagram of a target scene, and multi-view and multi-illumination light field data of a moving object are acquired and then the illumination effect of the moving object under the target scene is synthesized. The method mainly comprises the following steps that firstly the scene illumination radiation diagram is acquired from multiple scene light ball images of different exposures and decomposed into scene illumination elements; then clustering combination is performed on the illumination elements so that the sparse light field elements are obtained, and the number and the position of light field acquisition equipment light and video cameras are set according to the sparse light field elements; and finally the multi-view and multi-illumination light field data of the moving object are acquired in the light field acquisition equipment and the multi-view light and shadow effect of the moving object is synthesized. The moving object multi-view light and shadow synthesizing method based on the sparse light field elements can be widely applied to the aspects like film and television production.

Description

technical field [0001] The invention relates to the fields of computer vision and virtual reality, in particular to a multi-view light and shadow synthesis method for moving objects based on sparse light field primitives. Background technique [0002] Existing ray tracing algorithms can efficiently and realistically draw 3D models, but if an image or video similar to a real object is to be drawn, accurate 3D modeling of the scene and accurate extraction of material properties in the scene are required. Time consuming and in some cases impossible. To solve this problem, Image-Based Lighting (IBL) is proposed, which is an important method for realistically generating virtual scenes. The basic principle is to collect the multi-illumination and multi-view light field data of the target object, and generate the lighting effect of the collected object in the target scene through the linear addition of the difference of view angle and the light and shadow effect. However, this te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T15/06
Inventor 陈小武赵沁平方志宏杨梦夏吴洪宇
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products