Real-time removal method of calibration plate in augmented reality

A technology of augmented reality and calibration board, applied in image enhancement, image data processing, instruments, etc., can solve problems affecting the authenticity and aesthetics of augmented reality images, restricting applications, etc., and achieve stable effects, robust algorithms, and computing The effect of speed in real time

Active Publication Date: 2016-02-24
ZHEJIANG UNIV OF TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, this method requires that the calibration board must be placed in the video screen, which blocks some real scenes and affects the authenticity and aesthetics of the augmented reality screen, thus greatly limiting the application of this technology in the industry

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time removal method of calibration plate in augmented reality
  • Real-time removal method of calibration plate in augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] With reference to accompanying drawing, further illustrate the present invention:

[0028] A real-time removal method for a calibration plate in augmented reality, comprising the following steps:

[0029] 1), obtain the current frame image I from the camera device, and binarize the image;

[0030] 2), detect the two-dimensional position of the calibration plate from the binarized image, and define the quadrilateral surrounded by the four boundaries of the calibration plate as the calibration plate area Rm;

[0031] 3), according to the two-dimensional position of the calibration plate, calculate the three-dimensional position and orientation of the camera relative to the calibration plate, that is, the camera parameters;

[0032] 4) Drawing virtual objects according to camera parameters: using OpenGL drawing functions to projectively transform the 3D mesh of the virtual objects, and then use the Phong model for realistic drawing to obtain the drawing picture Iv of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time removing method for an augmented reality calibration plate. Picture holes existing after the calibration plate is removed are patched in real time through an image restoring method in an existing augmented reality system based on a calibration plate. The restoring method comprises the following steps that the position of the calibration plate in a video picture is obtained through camera calibration, and an area to be restored is determined; a linear feather image is computed and is combined with a current video frame image to be a texture image; a texture piece sample library is built for the non-patched area of the texture image; for the boundary pixels of the area to be restored, a neighborhood texture piece is used for conducting matching in the texture piece sample library, and the center point color of a texture piece obtained through matching is assigned to be the current boundary pixels; whether the restoring of all areas to be restored is achieved or not is judged, the restoring is over if yes, and if not, the restoring steps are conducted on the boundary pixels of the rest areas to be restored; finally, a previous frame restoring result and a current frame restoring result are used as the neighborhood, and bilateral filtering is conducted on the restoring result of the current frame.

Description

technical field [0001] The invention relates to a method for repairing a video frame, in particular to a method for real-time repairing of a video frame after removing a calibration plate in augmented reality. Background technique [0002] Augmented reality is a technology that enhances the observer's visual perception of the real world through the virtual information provided by the computer system. It uses related computer technology to superimpose the virtual scene into the video screen of the real environment in real time. In order to ensure the spatial consistency between the superimposed virtual scene and the real environment, it is necessary to use the camera calibration method to calculate the internal and external parameters of the camera. [0003] The current camera calibration methods are mainly divided into two categories: methods based on pure computer vision and methods based on other physical hardware. The calibration method based on pure computer vision need...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00
Inventor 陈佳舟秦绪佳
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap