AR drawing method combined with physical illumination model

Abstract

The invention discloses an AR drawing method combined with a physical illumination model, and the method comprises the following steps: S1, enabling an ARkit to capture a current AR scene, enabling the ARkit to be rendered to a texture through an OpenGL, and enabling the texture to serve as a background texture; S2, establishing a Scene scene by using Metal + Scene kit; S3, recording 2D screen track coordinates of the paintbrush, obtaining a current camera V matrix and a current camera P matrix, and sequentially converting the 2D screen track coordinates into 3D space coordinate tracks; S4, generating a uniform and smooth 3D space trajectory coordinate by adopting an interpolation and curve smoothing algorithm; S5, calculating data such as vertex coordinates, normal lines, tangent lines, texture coordinates and RGB (red, green and blue) according to the 3D space trajectory coordinates, deducing and constructing 3D geometric figure nodes with a deformation effect according to an ellipsecalculation formula, and adding the nodes into the Scene scene; S6, adopting a PBR physical illumination model to calculate the illumination effect, carrying out multiple sampling to eliminate sawteeth, rendering a Scene scene through Metal, and rendering a 3D graph to OpenGL and Metal shared textures; and S7, fusing the background texture and the shared texture, and rendering the final pattern to the screen by the OpenGL.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to an AR painting method combined with a physical lighting model. Background technique [0002] At present, most space painting technologies are based on VR (virtual reality) space brushes, which need to use VR devices and handles to realize artistic creation in virtual scenes. If there is no glasses reality device as a carrier, it is impossible to experience 3D scene painting. In the era of mobile Internet, electronic mobile terminals and AR (Augmented Reality Technology) are developing rapidly, and augmented reality applications based on mobile terminals are becoming more and more popular. Today's human-computer interaction and computer graphics are still in the stage of using a variety of equipment to assist them. The complicated operation makes them lose the fun of creating paintings. Therefore, the combination of AR technology and graphics rendering algorithms is ...

AI Technical Summary

Problems solved by technology

Today's human-computer interaction and computer graphics are still in the stage of using a variety of equipment to assist them. The complicated operation makes them lose the fun of creating paintings. Therefore, the combination of AR technology and graphics rendering algorithms is applied to hand-held devices with limited resources and computing power. Mobile terminals have subsequently become a research hotspot

Images