Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Reconstruction model registration method based on spatial three-point alignment

A three-dimensional model and model technology, applied in the field of virtual reality, can solve the problems of reducing the user's immersion experience and the marker cannot be correctly identified, and achieve the effect of improving the immersion experience.

Active Publication Date: 2020-02-07
XIDIAN UNIV
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the marker is partially or fully occluded, the marker cannot be recognized correctly, causing the reconstructed scene to disappear in the real scene, reducing the user's immersive experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reconstruction model registration method based on spatial three-point alignment
  • Reconstruction model registration method based on spatial three-point alignment
  • Reconstruction model registration method based on spatial three-point alignment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

[0032] refer to figure 1 , the present invention comprises the following steps:

[0033] Step 1) Reconstruct the 3D model:

[0034]Step 1a) Use the RGBD camera to shoot the real scene of the user's surrounding environment, and obtain N image pairs composed of depth images and color images, wherein the RGBD camera is a camera that can measure depth, and the real scene of the user's surrounding environment Including the tracker, two locators and other objects that are not on the same straight line, the locator is used for the virtual reality device to determine its own pose, and the tracker is used to obtain the coordinates of the tracker's location, N≥6, the collected image pairs must be completely covered The user's environment, in this embodiment N=15, each depth image and color image contains Pn pixels, Pn≥90000, each pair of dept...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a reconstruction model registration method based on spatial three-point alignment, which is used for solving the technical problem of poor immersion experience when a user usesmixed reality equipment, and comprises the following steps of: (1) reconstructing a three-dimensional model; (2) acquiring three-dimensional coordinates of the tracker and the two positioners; (3) establishing three vectors X1, Y1 and Z1 which are perpendicular to one another in a real scene; (4) establishing three vectors Xr, Yr and Zr which are perpendicular to one another in the three-dimensional model; (5) calculating a rotation matrix R from the three-dimensional model to a real scene; (6) calculating a translation vector T from the three-dimensional model to a real scene; and (7) obtaining a three-dimensional model aligned with the real scene. Once the coordinates of the three groups of points of the tracker and the two positioners are obtained, the coordinates cannot be changed dueto external conditions, so that the three-dimensional model cannot disappear due to movement, visual angle change or movement shielding of a user, and the immersion experience of the user when the user uses the mixed reality equipment is improved.

Description

technical field [0001] The invention belongs to the technical field of virtual reality, and relates to a method for registering a reconstructed model in a real scene, in particular to a method for registering a reconstructed model in a real scene based on spatial three-point alignment, which can be used when a user uses a mixed reality device to The reconstructed models are shown in real scenes. Background technique [0002] When users use mixed reality devices, they need to display the model somewhere in the real scene. This process is called model registration. The model may disappear due to the user's movement, perspective change, or motion occlusion. Therefore, whether the model can stably exist in the real scene will directly affect the user's immersive experience. [0003] The traditional method of registering a model in a real scene uses a virtual model to be registered in a real scene, so when a user uses a mixed reality device, collisions with obstacles may occur, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/20G06T19/00
CPCG06T17/20G06T19/006
Inventor 姜光李凌溪吴家杰
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products