Virtual-real mutual reflection method and device based on augmented reality, medium and equipment

Abstract

The invention relates to the technical field of augmented reality, and provides a virtual-real mutual reflection method based on augmented reality. According to the invention, real scene modeling is carried out to form a real environment layer; wherein the real environment forms a real object model bg. A virtual object rendering layer forms a virtual object fg; the reflection data of the virtual object is rendered in the real environment to form a virtual-to-real environment reflection layer; meanwhile, the reflection data of the real object model on the virtual object is rendered to obtain areal-to-virtual object reflection layer; and performing virtual-real fusion on the virtual-to-real environment reflecting layer, the real-to-virtual object reflecting layer, the real environment layerand the virtual object rendering layer to obtain a synthesis result with virtual-real object mutual reflection data. Based on the idea of virtual-real fusion, different reflection information is separately processed, then the reflection information is flexibly and rapidly stored by utilizing a multi-layer framework technology, and finally mutual reflection of virtual and real objects is realized.

Description

technical field [0001] The present application relates to the technical field of augmented reality (AR), in particular to a method, device, medium and equipment for virtual-real interreflection based on augmented reality. Background technique [0002] The fusion of virtual and real is the ultimate goal in the field of augmented reality (AR), which is to superimpose the real scene and the virtual scene without conflict. Illumination consistency is one of the key issues in the research of virtual-real fusion, which means that the shadow distribution and shading effect of the light source on the real scene and the virtual scene are consistent with the real effect. It embodies the impact of lighting in real scenes on virtual and real objects, such as light and shade, shadows, reflections, etc. [0003] Most of the current virtual studios or AR applications on the market focus on the processing of shading and shadow effects on virtual and real objects, and lack research on the r...

AI Technical Summary

Problems solved by technology

The difficulty lies in the fact that it is difficult to obtain real-time material information of the real environment, the calculation of the diffuse reflection component and specular reflection component information of each material is large, and there are many uncontrollable factors

Images