Augmented reality method based on binocular camera and humanoid robot

Abstract

The invention relates to an augmented reality method based on a binocular camera and a humanoid robot, and the method comprises the steps of: (1) obtaining the position and rotation information of a humanoid robot, obtaining the pose information of a binocular camera, and restoring the pose information of a virtual binocular camera; (2) collecting video images in real time, carrying out depth calculation on the video images, and obtaining shot live-action video data and depth information; (3) restoring the acquired video images by using the depth information to obtain a 3D virtual scene structure, and fusing the virtual scene and the live-action video; and (4) transmitting the synthesized binocular video to a client through a network. According to the method, real scene data can be collected in real time, images are processed in combination with related algorithms, analysis and structural reconstruction are carried out on shot scene pictures, and geometric virtual objects are fused, so that accurate virtual-real fusion is achieved, the watching feeling of experiencers is improved, real-time transmission is achieved, and the accuracy, the reality sense, the immersion sense and the interactivity are greatly improved.

Description

technical field [0001] The invention belongs to the technical field of augmented reality, in particular to an augmented reality method based on a binocular camera and a humanoid robot. Background technique [0002] With the popularization of the Internet and the development of augmented reality technology, robot technology is becoming more and more mature, and robots can help humans to complete some tasks more and more in daily life. In some special industries or remote situations, a humanoid robot can be used to replace the user at the scene, and the user can also have an immersive experience after transmitting the images collected and received by the robot to the client. However, the existing augmented reality technology has many problems and defects. For example, the existing augmented reality technology is mainly used on mobile platforms, using a monocular camera, and the effect is only displayed on a 2D plane, resulting in a weak sense of experience and immersion. In a...

AI Technical Summary

Problems solved by technology

[0003] In order to overcome the problem of inaccurate positioning of existing binocular cameras in complex environments, the present invention proposes an augmented reality method based on binocular cameras and humanoid robots, which can collect real-time data in real time and superimpose virtual digital models to achieve real-time Transmission, its accuracy, real-time, realism, immersion, and interactivity have all been greatly improved

Images