Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual viewpoint rendering method

A technology of virtual viewpoint and eight-point method, which is applied in the field of virtual viewpoint drawing, can solve the problems of narrow application range, time-consuming, unsatisfactory work, etc., and achieve the effects of expanding application range, improving real-time performance, and wide application range

Active Publication Date: 2013-10-09
TIANJIN UNIV
View PDF6 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Some of the existing virtual viewpoint rendering methods cannot obtain high-quality virtual viewpoint images, and the other part requires time-consuming calibration of the camera before image acquisition and the need to obtain depth images at the same time. These methods cannot guarantee real-time performance. In the case of wide baseline The work is not ideal, and the scope of use is narrow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint rendering method
  • Virtual viewpoint rendering method
  • Virtual viewpoint rendering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0029] This method first judges whether the position or angle of the camera has changed. If there is no change, the original basic matrix is ​​used for subsequent processing; if there is a change, the feature extraction, feature matching and calculation Fundamental matrix, then calculate the homography matrix based on the fundamental matrix and use View Morphing [1] Follow-up processing, among them, view warping technology is one of the IBR methods using implicit geometric information, this technology uses the principle of geometric projection to reconstruct each new viewpoint on the line between the optical centers from the images of two different viewpoints in the same 3D scene Image. In practical applications, this technology is gr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed in the utility model is a virtual viewpoint rendering method. The method comprises the following steps: obtaining a set of left and right viewpoint images shot by a camera and carrying out SIFT feature extraction on the set of viewpoint images to generate feature points and a feature vectors; carrying out Euclidean distance-based feature matching on the feature points of the left and right viewpoint images by the feature vectors to obtain a matching point pair set; calculating a basis matrix for the matching point pair set by using a random sample consensus method and an eight-point method; using homography decomposition to calculate homography matrixes of the left and right viewpoint images based on the basis matrix and using the corresponding homography matrixes to correct the left and right viewpoint images; carrying out stereo matching on the corrected left and right viewpoint images and generating an intermediate viewpoint image by interpolation and synthetizing; carrying out postposition conversion on the synthetized intermediate viewpoint image to obtain a virtual viewpoint image; and carrying out hole filling on the virtual viewpoint image and outputting a final virtual viewpoint image. According to the invention, the real-time performance is improved; the application range is expanded; and software has been made based on the method and is applied to experiment and application.

Description

technical field [0001] The invention relates to the field of image processing and stereoscopic imaging based on binocular vision, in particular to a virtual viewpoint rendering method. Background technique [0002] The virtual viewpoint rendering technology refers to calculating the scene image of the non-existing virtual camera viewpoint through the images of the same three-dimensional scene obtained from two or more camera viewpoints. It involves fields such as computer graphics, computer vision, and digital image processing. [0003] In the prior art, the virtual viewpoint rendering technology is mainly implemented through Image Based Rendering (IBR). Different IBR technologies can be understood as the specific performance of the plenoptic function (Plenoptic Function) under certain conditions. IBR technologies include: IBR methods using implicit geometric information. [0004] The IBR method using implicit geometric information requires only a few input images, and can...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/00
Inventor 苏育挺刘安安马玉龙
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com