Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-robot motion planning method and system and storage medium

A technology for robot motion and robotics, applied in motor vehicles, control/regulation systems, instruments, etc., to solve the problems of slow convergence of reinforcement learning, inability to clearly define reward function values, and poor predictability.

Pending Publication Date: 2021-07-13
GUANGDONG UNIV OF TECH
View PDF1 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional reinforcement learning used in the autonomous robot motion planning system in an unknown dynamic multi-obstacle environment will face three problems: 1) when the state space and action space are continuous or the number is too large, the reinforcement learning convergence speed is too slow; 2) the agent is learning In the early stage, it is a blind search, and the foresight ability is poor; 3) The reward function value of the environment for each action cannot be clearly defined

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-robot motion planning method and system and storage medium
  • Multi-robot motion planning method and system and storage medium
  • Multi-robot motion planning method and system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047]Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. For the step numbers in the following embodiments, it is only set for the convenience of illustration and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art sexual adjustment.

[0048] First, explain the technical terms involved in the technical solution of this application:

[0049] The Q-Learning algorithm is a model-independent reinforcement learning algorithm that directly optimiz...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a multi-robot motion planning method and system and a storage medium. The method comprises the following steps: acquiring the motion state and environment information of robots in motion; determining a motion strategy of the robot through reinforcement learning according to the discretized motion state and environment information, wherein the continuous action in the motion strategy is obtained by determining a reinforcement learning state space by using a fuzzy neural network and outputting the obtained continuous action; determining a basic behavior of the robot according to the motion strategy, and performing cluster motion, wherein the basic behaviors comprise at least one of the following behaviors: advancing to a target, obstacle avoidance movement, collision avoidance movement and movement along a wall. The method solves the problems that the convergence speed is too low and the predictive ability is poor when optimal behavior strategy learning is carried out on the intelligent body in a huge state space and a dynamic change environment, and can be widely applied to the technical field of robot control.

Description

technical field [0001] The invention relates to the technical field of robot control, in particular to a method, system and storage medium for multi-robot motion planning. Background technique [0002] Motion planning is a hot topic in the research of multi-mobile robots. At present, the motion planning of multi-mobile robots mainly includes three control behaviors: path planning, formation control, and obstacle avoidance and collision avoidance. Among the many motion coordination algorithms, a new coordination method - flocking (Flocking) control mode is a new type of distributed control method that simulates the biological aggregation movement in nature. The three aspects of obstacles and movement towards the goal point coincide exactly with the three models of swarm movement: separation, alignment and convergence. [0003] The advantage of cluster control lies in formation gathering, stable formation, and the ability to avoid certain obstacles and move towards the targe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G05D1/02
CPCG05D1/0242G05D1/0253G05D1/0257G05D1/0223G05D1/0214
Inventor 汪明慧曾碧王秋杰王志宇
Owner GUANGDONG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products