Autonomous Grasping Method of Robotic Arm Based on Deep Reinforcement Learning and Dynamic Motion Primitives

A technology of reinforcement learning and dynamic motion, applied in the field of robotic arm and deep reinforcement learning training system, which can solve problems such as large mutation value and robot joint damage

Active Publication Date: 2022-06-21
NANTONG UNIVERSITY
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the joint motion of the robot is driven and controlled by the motor, if the motion trajectory (angle trajectory, angular velocity trajectory and angular acceleration trajectory) of the motor has large fluctuations, the driving torque of the motor will also have large fluctuations at this time. even large mutation values, which can easily cause damage to robot joints

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Autonomous Grasping Method of Robotic Arm Based on Deep Reinforcement Learning and Dynamic Motion Primitives
  • Autonomous Grasping Method of Robotic Arm Based on Deep Reinforcement Learning and Dynamic Motion Primitives
  • Autonomous Grasping Method of Robotic Arm Based on Deep Reinforcement Learning and Dynamic Motion Primitives

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0044] In the description of the present invention, it should be noted that, unless otherwise expressly specified and limited, the terms "installed", "provided with", "connected", etc. should be understood in a broad sense, for example, "connected" may be a fixed connection It can also be a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an autonomous grasping method of a mechanical arm based on deep reinforcement learning and dynamic motion primitives, which includes the following steps: Step 1: Install a camera image component to ensure that the recognition area is not blocked, and preprocess the image of the captured target area , and sent to the deep reinforcement learning agent as state information; Step 2: Construct a local policy proximal optimization training model based on the state and deep reinforcement learning principles; Step 3: Construct a new dynamic motion primitive and imitation learning Hybrid motion primitive model; Step 4: Based on the model, train the robotic arm to autonomously grasp objects. The present invention can effectively solve the problem of unsmooth joint motion of the mechanical arm based on traditional deep reinforcement learning. By combining the dynamic motion primitive algorithm, the meta-parameter learning problem is transformed into a reinforcement learning problem, and the training method of deep reinforcement learning can be used to make the mechanical arm Complete autonomous grabbing tasks.

Description

technical field [0001] The invention relates to the technical field of a robotic arm and a deep reinforcement learning training system, in particular to an autonomous grasping method of a robotic arm based on deep reinforcement learning and dynamic motion primitives. Background technique [0002] At present, the research of robotics technology has shifted from traditional mechanical dynamics to intelligent control, especially after comprehensively absorbing research results in the fields of control theory, artificial neural network and machine learning, robotics has gradually become an artificial intelligence One of the cores of the field. As one of the research hotspots in the field of machine learning in recent years, deep reinforcement learning has achieved rich results in both theoretical research and practical applications. However, a good deep reinforcement learning algorithm is not enough for robots to solve real-life problems. This is because the control strategy o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): B25J9/16B25J19/04
CPCB25J9/16B25J19/04B25J9/163B25J9/1664
Inventor 袁银龙华亮李俊红徐一鸣程赟
Owner NANTONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products