Robot arm teleoperation method, device and system and medium

Abstract

The invention discloses a robot arm teleoperation method, device and system and a medium, and relates to the field of robot teleoperation. The method comprises the steps that a hand image of an operator at the current moment is collected, and image recognition is conducted on the hand image, so that the hand position of the operator and the gesture information of the operator at the current moment are obtained; an expected position parameter of the hand of the robot at the next moment is determined based on the mapping relation of the hand position of the operator at the current moment and a preset position, and an expected gesture of the hand of the robot at the next moment is also determined based on the mapping relation of the gesture information of the operator at the current moment and a preset gesture; and the expected position parameters are used for carrying out position control on the hand of the robot, the expected gestures are used for carrying out gesture control on the fingers of the robot, the hand image is detected and recognized through vision in the scheme, then the position and the gesture of the hand of the robot are determined, and the purpose of remote operation of the arm of the robot is achieved.

Description

technical field [0001] The invention relates to the field of remote operation of robots, in particular to a method, device, system and medium for remote operation of a robot arm. Background technique [0002] Robot teleoperation is a technology that organically combines human decision-making ability with robot precision. Due to the limited degree of intelligence of robots at present, through robot teleoperation technology, operators can remotely control robots to complete some dangerous and difficult tasks. This technology has great application value in special fields such as aerospace, medical treatment, and explosion protection. Traditional robot teleoperation methods such as mouse, keyboard, and teleoperation stick only control the position and attitude of the traditional robotic arm. There is a problem that only simple teleoperation can be realized and the operation is difficult. However, based on data gloves and a few hand The remote operation method of wearable intera...

AI Technical Summary

Problems solved by technology

Traditional robot teleoperation methods such as mouse, keyboard, and teleoperation stick only control the position and attitude of the traditional robotic arm. There is a problem that only simple teleoperation can be realized and the operation is difficult. However, based on data gloves and a few hand The remote operation method of wearable interactive devices such as rings will limit the flexibility of human hand movement, and can only analyze basic static gestures

Images