Real-time picture projection method, device, controller and medium of ar glasses screen

Abstract

The present invention relates to a method, device, controller and medium for real-time image projection on the screen of AR glasses. The method includes detecting whether the AR glasses are connected to an external extended display; if so, collecting camera images through a camera installed on the AR glasses Collecting virtual UI through the main screen of the AR glasses; performing picture synthesis based on the camera picture and the virtual UI, generating a combined result picture and sending it to the extended display; combining the main screen of the extended display and the AR glasses The screen displays differentiated content. In the present invention, through the differentiated content display of the AR glasses screen and the extended display, the main screen of the glasses does not need to display camera images, and does not need additional servers to realize projection, which reduces development costs, enables rapid deployment, and improves user experience.

Description

technical field [0001] The present invention relates to the field of augmented reality technology, and in particular to a real-time image projection method, device, controller and medium of an AR glasses screen. Background technique [0002] In recent years, Augmented Reality (AR) technology has developed rapidly, and AR products are constantly being introduced. However, most of the products are mainly oriented towards professional or high-end users, and it is difficult for many people to understand or contact them. Therefore, they can use The AR glasses project the content presented on the screen, that is, the real-time images of the AR glasses screen, to the extended display to realize the promotion of AR technology and AR glasses and other products. The extended display is an external display connected to the AR glasses. [0003] The content presented on the screen by AR glasses is the superposition of the virtual user interface (UI) on the glasses screen and the real fie...

AI Technical Summary

Problems solved by technology

This technical means can avoid the decline of AR glasses user experience caused by simple screen mirroring. However, the synthesis of video stream images requires the support of the back-end video stream server, and the synthesis of video stream images will also cause delays. When displaying, an additional terminal with an independent computing unit is required to decode the video stream before it can be displayed on the extended display. This technical solution needs to rely on intermediate equipment, and at the same time, there is an additional burden on the development and deployment of related supporting software, which is costly. It is not suitable for rapid deployment of lightweight localization. In addition, most video streaming services rely on public network and wireless network support, and support for local small LAN, point-to-point Wi-Fi direct connection, and even wired transmission is extremely limited.

Images