Hexapod robot gait planning method based on depth reinforcement learning

A hexapod robot and reinforcement learning technology, which is applied in the field of gait planning of hexapod robots based on deep reinforcement learning, can solve problems such as the inability to realize gait planning, achieve the effects of reducing impact, improving the motion system, and improving performance

Active Publication Date: 2018-01-09
唐开强
View PDF3 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The technical problem to be solved by the present invention is that the traditional pre-pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hexapod robot gait planning method based on depth reinforcement learning
  • Hexapod robot gait planning method based on depth reinforcement learning
  • Hexapod robot gait planning method based on depth reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Such as figure 1 As shown, the gait planning method for a hexapod robot based on deep reinforcement learning disclosed in the present invention includes the steps of acquiring environmental information, completing environmental modeling, screening suitable footholds, formulating motion strategies, executing motion strategies, and starting to walk. Specifically, :

[0057] Step 1, obtain environmental information, and the hexapod robot obtains environmental road condition information through satellite maps and cameras;

[0058] Step 2: Carry out environmental modeling, discretize the obtained environmental road condition information by means of subdividing and discretizing the equal area, and segment the image as figure 2 As shown, the environmental road condition information is transformed into scattered and independent footholds similar to plum blossom piles, as shown in image 3 shown;

[0059] Step 3, screening of footholds. According to the hexapod robot’s own p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a hexapod robot gait planning method based on depth reinforcement learning. The method comprises the steps of environment information acquiring, environment modeling, anchor point screening, upper-level exercise policy formulating, lower-level policy executing and robot movement drive. Through the hexapod robot gait planning method, a hexapod robot uses a depth learning andreinforcement learning algorithm to acquire the optimal path by solving a quincuncial pile maze problem abstracted from an environment, and can select the suitable anchor point according to the optimal path to realize efficient walking in a non-structural environment.

Description

technical field [0001] The present invention relates to a robot gait planning method, in particular to a hexapod robot gait planning method based on deep reinforcement learning. Background technique [0002] The hexapod robot has multiple redundant degrees of freedom in structure, so it has a high adaptability to the terrain environment. Hexapod robots can walk in the field with complex road conditions, overcome obstacles, and complete transportation operations in non-structural environments that cannot be completed by wheeled or tracked types. They are used in forest logging, mining, underwater construction, nuclear industry, military transportation and It has a very broad application prospect in fields such as detection and planetary detection. Therefore, the research on hexapod robots has always attracted the attention of experts and scholars from various countries, but how to improve the mobility of hexapod robots in unstructured environments is still an unresolved issu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/02
Inventor 唐开强留沧海孙建洪俊刘佳生侯跃南艾攀华潘东旭钱勇
Owner 唐开强
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products