Real-time image projection method and device for AR glasses screen, controller and medium

Abstract

The invention relates to a real-time image projection method and device of an AR glasses screen, a controller and a medium. The method comprises the following steps: detecting whether AR glasses are connected with an external extended display or not; if yes, camera images are collected through a camera arranged on the AR glasses, and virtual UIs are collected through a main screen of the AR glasses; picture synthesis is performed based on the camera picture and the virtual UI, a synthesis result picture is generated and the synthesis result picture is sent to the extended display; and differential content display is carried out on the extended display and the main screen of the AR glasses. According to the invention, through differential content display of the AR glasses screen and the extended display, the main glasses screen does not need to display a camera picture, and does not need to additionally set a server and the like to realize projection, so that the development cost is reduced, rapid deployment can be realized, and the user experience is improved.

Description

technical field [0001] The present invention relates to the field of augmented reality technology, and in particular to a real-time image projection method, device, controller and medium of an AR glasses screen. Background technique [0002] In recent years, Augmented Reality (AR) technology has developed rapidly, and AR products are constantly being introduced. However, most of the products are mainly oriented towards professional or high-end users, and it is difficult for many people to understand or contact them. Therefore, they can use The AR glasses project the content presented on the screen, that is, the real-time images of the AR glasses screen, to the extended display to realize the promotion of AR technology and AR glasses and other products. The extended display is an external display connected to the AR glasses. [0003] The content presented on the screen by AR glasses is the superposition of the virtual user interface (UI) on the glasses screen and the real fie...

AI Technical Summary

Problems solved by technology

This technical means can avoid the decline of AR glasses user experience caused by simple screen mirroring. However, the synthesis of video stream images requires the support of the back-end video stream server, and the synthesis of video stream images will also cause delays. When displaying, an additional terminal with an independent computing unit is required to decode the video stream before it can be displayed on the extended display. This technical solution needs to rely on intermediate equipment, and at the same time, there is an additional burden on the development and deployment of related supporting software, which is costly. It is not suitable for rapid deployment of lightweight localization. In addition, most video streaming services rely on public network and wireless network support, and support for local small LAN, point-to-point Wi-Fi direct connection, and even wired transmission is extremely limited.

Images