Dual-camera video fusion distortion correction and viewpoint micro-adjustment method and system thereof

Abstract

The invention provides a dual-camera video fusion distortion correction and viewpoint micro-adjustment method and a system thereof. The method comprises the following steps of making an equal scale model, and using a single color of a large contrast to note a mark point; installing two environment cameras above a head-mounted device, using the environment cameras to shoot images and carrying out image fusion calibration; using a measuring tool to calibrate a position of a VR helmet relative to the environment cameras in a physical space, and according to an offset distance of the environment cameras and a head-mounted device viewpoint, calculating positions of the environment cameras in a world coordinate system; calibrating a video splicing parameter and a viewpoint micro-adjustment parameter; carrying out operation on each group of two frame images shot by the two environment cameras at the same time. In the invention, a displayed deviation problem of real equipment in the head-mounted device under different viewpoint micro-deviation conditions is solved, and deficiency and excess consistency is realized.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a dual-camera video fusion distortion correction and viewpoint fine adjustment method and system. Background technique [0002] In mixed reality technology (MR), how to seamlessly integrate the scene seen in the actual environment with the virtual scene, and conform to the perspective and field of view of the head-mounted device, as well as usage habits is a new technical difficulty. At present, there are several problems: first, the angle of view seen by human eyes and the angle of view of head-mounted devices are different, and the width of field of view is also different; second, the angle of view and field of view collected by a single camera are different from those of human eyes and head-mounted The type of equipment is also different. [0003] Generally, it is sufficient to use a wide-angle camera to obtain the field of view of the real scene in the left ...

AI Technical Summary

Problems solved by technology

At present, there are several problems: first, the angle of view seen by the human eye and the angle of view of the head-mounted device are different, and the width of the field of view is also different; equipment is also different

It is always impossible to associate with reality, which affects MR equipment users to rely on visual and intuitive judgments to operate real equipment, and cannot achieve the purpose of virtual and real fusion

Images