Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mixed reality virtual rendering method and device

A mixed reality and virtual scene technology, applied in the field of mixed reality virtual presentation methods and devices, can solve the problems of complex content, high cost, and complicated MR system implementation technology, and achieve the effect of strong sense of reality and low cost

Inactive Publication Date: 2017-08-01
深圳市云宙多媒体技术有限公司
View PDF0 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to achieve the effect of mixed reality, the current common presentation methods, such as Google glasses and Microsoft hololens, etc., directly superimpose the virtual constructed display image on the real image for mixed display. However, the content of the displayed image is often complex and requires complex algorithms. Calculate the superposition position of the virtual image and the real image, and the zooming, rotation and other processing required for the virtual image, in order to maximize the realism of the superimposed mixed image
Therefore, the disadvantages of the prior art are that the MR system is technically complicated, the cost is high, and the sense of reality is not good.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mixed reality virtual rendering method and device
  • Mixed reality virtual rendering method and device
  • Mixed reality virtual rendering method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] figure 1 It is a flow chart of a mixed reality virtual presentation method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of fusing real scenes and virtual scenes. The method can be executed by the mixed reality virtual presentation device provided by the embodiment of the present invention, the device can be implemented in the form of software and / or hardware, and generally can be integrated into mixed reality glasses for displaying mixed reality scenes. like figure 1 As shown, the method of this embodiment specifically includes:

[0032] S110. Use the camera to move and shoot, and acquire at least two plane determination images that match the user's field of view.

[0033] In this embodiment, the camera is configured on the mixed reality glasses worn by the user, and is used to simulate the user's eyes to obtain the scenery in the surrounding environment, and then can more accurately determine the space included in ...

Embodiment 2

[0045] Figure 2a It is a flow chart of a mixed reality virtual presentation method provided by Embodiment 2 of the present invention. This embodiment is further optimized on the basis of the above embodiments. In this embodiment, images will be determined according to the at least two planes, and the spatial grid planes included in the user's field of view will be drawn. The specific optimization is as follows: Extracting feature points from the at least two plane determination images, and marking the positions of the same feature points in the at least two plane determination images; according to the positions of the same feature points in different plane determination images, the same The motion feature parameters of the feature points; according to the motion feature parameters, draw the spatial grid plane included in the user's field of view.

[0046] Correspondingly, the method in this embodiment specifically includes:

[0047] S210. Use a camera to move and shoot, and...

Embodiment 3

[0087] Figure 3a It is a flow chart of a mixed reality virtual presentation method provided by Embodiment 3 of the present invention. This embodiment is further optimized on the basis of the above embodiments. In this embodiment, the virtual scene corresponding to the 3D object to be displayed is determined according to the spatial grid plane for further refinement;

[0088] Before outputting the virtual scene to the mixed reality glasses, it also preferably includes: shielding the video captured by the camera and the drawn spatial grid plane;

[0089] At the same time, outputting the virtual scene to the mixed reality glasses is specifically optimized as: decomposing the virtual scene into two-channel video content, and outputting the two-channel video content to different lenses of the mixed reality glasses .

[0090] Correspondingly, the method in this embodiment specifically includes the following steps:

[0091] S310. Use a camera to move and shoot, and acquire at lea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention discloses a mixed reality virtual rendering method and device. The method comprises the steps of, performing mobile shooting via a camera to obtain at least two plane determining images matching a user's field of view; according to the at least two plane determining images, drawing a spatial grid plane included in the user's field of view; according to the spatial grid plane, determining a virtual scene corresponding to a 3D object to be displayed; outputting the virtual scene to a pair of mixed reality glasses so that a user observes a mixed reality scene formed by combination of the virtual scene and a real scene obtained by the mixed reality glasses. The embodiment is advantageous in that, via the images collected by the camera, a spatial plane corresponding to the real scene is determined, and the 3D object and the spatial plane are combined to form a virtual image, and therefore, sense of reality of the formed virtual image is high, the purpose of lying to the human brain is reached to some extent, distinguishing the real scene from the virtual scene is hard, and realization cost is reduced.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of mixed reality, and in particular, to a method and device for virtual presentation of mixed reality. Background technique [0002] MR (Mixed Reality, mixed reality technology) is a technology that mixes and superimposes real world information and virtual world information, involving new technologies and technologies such as multimedia processing, 3D modeling, real-time video display and control, real-time tracking, and scene fusion. new means. The MR system has three outstanding features: ① Information integration between the real world and the virtual world; ② Real-time interactivity; ③ Adding and positioning virtual objects in the three-dimensional scale space. MR technology can be widely used in military, medical, construction, education, engineering, film and television, entertainment and other fields. [0003] In order to achieve the effect of mixed reality, the current common ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00
CPCG06T19/006
Inventor 吴金勇
Owner 深圳市云宙多媒体技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com