Experimental system and method for augmented reality of teleoperation of robot

Abstract

The invention discloses an experimental system and method for augmented reality of teleoperation of a robot. The system comprises a robot, a two-path video collecting device, a server, a client and a display device. The two-path video collecting device collects the scene data and transmits the collected two-path video stream to the server; the server receives the two-path video stream and the gesture parameters of the robot, processes the data and transmits the processed data to the client; the client processes the data for the two-path video stream and the gesture parameters of the robot transmitted from the server and establishes a virtual interactive mode which is operated in various ways through instructions sent by the client; and the virtual interactive model established by the client is displayed in a stereo display device. By adopting the experimental system and method for augmented reality of teleoperation of a robot, an environment of simulation test for augmented reality is established, the robot and the actual scene can be displayed by a three-dimensional way, and a teleoperation interactive information mode is established to carry out corresponding experimental operations.

Description

technical field [0001] The invention relates to a remote operation experiment system, in particular to a robot remote operation experiment system. Background technique [0002] The existing robot teleoperation experiment system observes the real experimental environment in the form of two-dimensional pictures through the optical positioning system. The optical positioning system can be divided into three categories according to the light source: infrared positioning, visible light positioning and laser positioning. The most widely used of these is the use of bright infrared spots to mark the position of targets. [0003] The center point of the target in the positioning system is determined by calculating the particle brightness of the speckle image. A stain or a partial occlusion can affect the position of the centroid, causing an apparent measurement error. Also, this situation will not be detected and will not alert the user. The error between the left and right views ...

AI Technical Summary

Problems solved by technology

[0004] The disadvantage is that the spatial relationship between the marker point and any tool used to track the position of the object (such as a probe tool) can only be displayed in a two-dimensional manner, and cannot be displayed intuitively to the user in a three-dimensional manner for easy processing. Dynamic visual ratio, which leads to inconvenient use and does not give a clearer representation of the composition; difficulty in identifying numerous samples that differ only slightly from each other; when using other positioning instruments, placing an optical positioner in the peripheral and then repeating Placement, which leads to complicated installation, and needs to estimate the fuzzy boundary 1 to 2 meters away; cannot recognize multiple sets of marks at the same time

Images