A UAV Path Planning Method Based on q(λ) Algorithm

Abstract

The invention provides a UAV mission planning method based on the Q(λ) algorithm, which includes an environment modeling step, a Markov decision process model initialization step, a Q(λ) algorithm iterative calculation step, and calculating the most In the optimal path step, first initialize the grid space according to the length of the minimum track segment of the UAV, map the coordinates of the grid space to waypoints, and represent the circular and polygonal threat areas, and then establish a Markov decision model, including Man-machine flight action space representation, the design of state transition probability, the construction of reward function, and then use the Q(λ) algorithm to iteratively calculate on the basis of the constructed model, and calculate a path that can safely avoid For the optimal path of UAVs in threat areas, the invention combines the traditional Q-learning algorithm with utility tracking, improves the speed and accuracy of value function convergence, guides UAVs to avoid threat areas and performs autonomous path planning.

Description

technical field [0001] The invention relates to an unmanned aerial vehicle, specifically a path planning method for an unmanned aerial vehicle, belonging to the technical field of heuristic algorithms. Background technique [0002] UAV path planning is an important part of UAV mission planning and an important stage to realize autonomous mission execution of UAV. UAV path planning requires that in an environment with known, partially known or completely unknown information, it is planned to reach the target point from the starting point, which can bypass the threat area and obstacles, be safe, reliable and collision-free, and meet various requirements at the same time. A flight path with constraints. According to the acquisition of the battlefield environment information where the UAV is located, the path planning is divided into global path planning and local path planning. [0003] In practical applications, if the UAV can acquire global environmental knowledge, dynamic ...

AI Technical Summary

Problems solved by technology

[0004] The current local path planning technology has problems such as the algorithm is easy to fall into local minimum or local oscillation, the time cost of the algorithm is large, the computer information storage is large, and the rules are difficult to determine.

The behavior-based UAV path planning method is called the hotspot of current research. Its essence is to map the environmental state perceived by the sensor to the action of the actuator. In the behavior-based method, the design of the state feature vector and the supervised sample It is often very difficult to obtain in the actual complex environment

Images