Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Free view angle relighting method and system based on photometric stereo

A photometric stereo and heavy lighting technology, which is used in stereo photography, optics, 3D image processing, etc., and can solve problems such as the difficulty of heavy lighting in dynamic scenes.

Inactive Publication Date: 2010-10-27
TSINGHUA UNIV
View PDF4 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to overcome the deficiencies of the prior art, especially to solve the defect of difficult re-lighting of dynamic scenes in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Free view angle relighting method and system based on photometric stereo
  • Free view angle relighting method and system based on photometric stereo
  • Free view angle relighting method and system based on photometric stereo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0044] The core idea of ​​the present invention is to use the dynamic scene video under controllable illumination shot from multiple perspectives, and combine the results of confidence judgment to perform photometric stereo calculation on the video images obtained from each single perspective, so as to obtain the target object in each single perspective. The normal and reflection characteristics information of the surface in the visible area of ​​the viewing angle. Then, the normal direction and reflection characteristic information of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a free view angle relighting method based on photometric stereo, which comprises the steps of: acquiring a multi-view angle dynamic video image of a target object by using a multi-view angle photographic array; acquiring a three-dimensional model of the target object and a surface reflection characteristic of the model according to the acquired multi-view angle dynamic video image; acquiring a static three-dimensional object relighting model and a three-dimensional motion trail of the target object; acquiring dynamic three-dimensional object relighting models of the target object in every moment according to the three-dimensional motion trail of the target object and the static three-dimensional object relighting model; and rendering the dynamic three-dimensional object relighting model of the target object on the basis of the free view angle given by a user so as to realize the free view angle relighting of the target object, wherein the rendering to the dynamic three-dimensional object relighting model depends on a free view angle given arbitrarily by a user. The dynamic scene relighting method provided by the invention is high-efficiency and supports the observation with free view angles.

Description

technical field [0001] The present invention relates to the field of digital image processing, in particular to a method combining photometric stereo, using a multi-view camera array to collect dynamic video under controllable lighting conditions, restoring the normal direction and reflection characteristics of a target object, and re-illuminating from a free view angle and system. Background technique [0002] With the rapid development of digital acquisition and processing technology, dynamic video has become a widely existing media format in daily life and scientific research. In the process of video processing and playback, lighting conditions have a crucial impact on video quality and effects. In addition, different shooting angles will also bring different effects. Especially for dynamic objects of interest, in order to observe the object from a free perspective and generate different effects of the object under arbitrary lighting conditions, it is necessary to perfor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/50G03B35/08G03B15/02
CPCG06T2207/30241G06T2207/10152G06T7/0073G06T2200/04G06T2207/10021G06T7/586
Inventor 戴琼海李冠楠
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com