Vision computing and inertial measurement unit-based virtual reality interactive device

Abstract

The invention discloses a vision computing and inertial measurement unit-based virtual reality interactive device in the technical field of virtual reality interaction. The interactive device comprises a three-dimensional display device, an industrial camera module, three-dimensional glasses, a user interactive peripheral and a computer system, wherein the industrial camera module obtains two or more image signals in a view field range and inputs the image signals to the computer system; and the computer system distinguishes and tracks mark points or active luminous components with high-reflective coatings on the three-dimensional glasses worn by a user and the user interactive peripheral, and outputs a focal point of a sight line of the user and the three-dimensional display device, and spatial position and direction of the user interactive peripheral. The interactive device can be used on desktop-level or large-screen projection and has expansibility and maintainability; and high precision and low time delay can be achieved, continuous operation can be performed, and sight line shielding does not exist.

Description

technical field [0001] The invention relates to the technical field of virtual reality interaction, in particular to a virtual reality interactive device based on visual computing and an inertial measurement unit. Background technique [0002] With the rapid development and widespread popularization of computer technology, the way of communication between humans and computers has become a new research field. In the research of human-computer interaction, people pursue the most natural way of interaction. The most popular new interaction technology in the market is multi-touch technology, which replaces the traditional mouse and keyboard with fingers as the controller. operating mode. Although this interaction method is simple and easy to understand, it still has a distance from the "most natural interaction method". In order to simulate human language communication and body communication, speech recognition technology and image recognition technology are flourishing. For ...

AI Technical Summary

Problems solved by technology

[0005] However, at present, high-precision motion tracking, especially tracking with an accuracy of about 1 mm, is particularly difficult. It is difficult to obtain high-precision calculation accuracy by relying on multi-eye vision system tracking alone, especially in the case of line-of-sight occlusion. , the passive optical positioning system has this problem

In the near-infrared system, when the infrared light is blocked by the user or an object, the three-dimensional reconstruction of the space is likely to fail due to the lack of corresponding information of the feature points in the two-dimensional image.

Images