Remote synchronous cooperation system based on mixed reality

Abstract

The invention discloses a remote synchronous cooperation system based on mixed reality, which can achieve real-time synchronous cooperation of a local end and a remote end. The system comprises a remote expert terminal and a local user terminal. The local user side is arranged in a working environment; the local user side is composed of an augmented reality head-mounted display, a local side tracking module, a depth camera and a local computer; the remote expert terminal is composed of a virtual reality head-mounted display, a handheld controller, a remote terminal tracking module and a remote computer. According to the invention, the problem of mutual shielding among a plurality of local users in the working environment is solved through the depth camera, the local working environment information is updated in real time through the camera of the augmented reality helmet worn by the local users, and the timeliness of the information is distinguished through processing in the virtual environment. A remote expert can issue suggestions and instructions in a virtual reality environment, and the information is displayed in the view angle of a local user through an augmented reality helmet-mounted display so as to visually guide the local user to work.

Description

technical field [0001] The invention relates to the technical field of mixed reality, in particular to a remote synchronous collaboration system based on mixed reality. Background technique [0002] At present, some studies have proposed a synchronous sharing technology based on MR. Experts wear VR head-mounted displays, local users wear AR head-mounted displays, and transmit the content captured in the AR head-mounted displays to the virtual reality head-mounted displays. This way, experts can observe and make recommendations on the progress that local users are making in the work environment. [0003] When the current technology builds the working environment into the virtual reality space, the camera worn by the local user is used to construct it, so the information outside the field of view of the local user cannot be accurately presented, and remote experts cannot have a clearer grasp of the overall information. When multiple local users are working, mutual occlusion m...

AI Technical Summary

Problems solved by technology

[0003]When the current technology builds the working environment into the virtual reality space, it is built through the camera worn by the local user, so it cannot accurately present the information outside the field of view of the local user. Remote experts cannot have a clearer grasp of global information. At the same time, when multiple local users are working, mutual occlusion may also lead to loss of working environment information

Images