A Conflict Resolution Method for Heterogeneous Platforms Based on Graph Neural Network Reinforcement Learning

A neural network and conflict resolution technology, applied in the field of heterogeneous multi-aircraft conflict resolution, to achieve the effect of a reasonable conflict resolution strategy

Active Publication Date: 2022-03-29
BEIHANG UNIV
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In view of the fact that the deep reinforcement learning method is difficult to solve the conflict resolution problem of heterogeneous platform aircraft, a conflict resolution method that can solve heterogeneous platforms is proposed based on graph neural network reinforcement learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Conflict Resolution Method for Heterogeneous Platforms Based on Graph Neural Network Reinforcement Learning
  • A Conflict Resolution Method for Heterogeneous Platforms Based on Graph Neural Network Reinforcement Learning
  • A Conflict Resolution Method for Heterogeneous Platforms Based on Graph Neural Network Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail and in-depth below in conjunction with the accompanying drawings.

[0038] The present invention provides a conflict resolution method for heterogeneous platforms. The problem to be considered is: for a designated airspace, there are M class-a aircraft and N class-b aircraft, and it is necessary to ensure that each aircraft can safely reach the target point from the starting point. And minimize the number of collisions between aircraft. Such as figure 1 Shown is a schematic diagram of a scenario for this problem.

[0039] The heterogeneous platform conflict resolution method, such as figure 2 As shown, the specific steps are as follows:

[0040] Step 1, according to the specific types and characteristics of each heterogeneous aircraft, set the corresponding state vector, action space vector, and the maximum n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a conflict resolution method for heterogeneous platforms based on graph neural network reinforcement learning, which includes the following steps: first, set corresponding state vectors and action space vectors according to the specific types and characteristics of each heterogeneous aircraft; The starting position of the quality aircraft, the position of the target point and related state information, establish a conflict network graph structure according to the state and environmental information, and establish a conflict degree evaluation function; then establish a graph neural network structure and conduct training; finally use the trained graph neural network The network model completes the conflict resolution of heterogeneous platforms. The graph neural network structure of the present invention encodes the state vectors of heterogeneous aircraft into state vectors of the same dimension through the state information encoding module, the graph convolution network module extracts feature vectors, the action selection module obtains state-action values, and combines reinforcement learning to train each The heterogeneous aircraft provides an effective and feasible solution to the conflict resolution problem of heterogeneous platforms.

Description

technical field [0001] The invention belongs to the technical field of aircraft, and relates to a conflict resolution method for heterogeneous multi-aircraft based on graph neural network reinforcement learning. Background technique [0002] The air-to-air platform refers to the part between the space in the aviation field and the aerospace field, and its height ranges between 20-100km. The air-to-air platform aircraft refers to the aircraft that flies on the air-to-air platform and performs related tasks. Its different types It can complete tasks such as reconnaissance, environmental monitoring, electronic countermeasures, material delivery, and military strikes. It has very important strategic value for social people's livelihood and national security. In recent years, due to the advancement of science and technology and the importance attached to the air-to-air platform by governments of various countries, the research and development of the air-to-air platform aircraft h...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F30/15G06F30/27G06N3/04G06N3/08
CPCG06F30/15G06F30/27G06N3/04G06N3/084
Inventor 李宇萌张云赫郭通杜文博
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products