Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Topology Optimization Method for Wireless Sensor Networks Based on Asynchronous Deep Reinforcement Learning

A wireless sensor and reinforcement learning technology, applied in network topology, neural learning methods, network planning, etc., can solve problems such as dependence on computing resources, data optimization results oscillation, etc., to improve the ability to resist attacks, speed up convergence time, and reduce correlation sexual effect

Active Publication Date: 2022-05-03
TIANJIN UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, the journal "Deep Actor-Critic Learning-basedRobustness Enhancement of Internet of Things" proposes a strategy for intelligent wireless sensor network topology based on deep reinforcement learning, but in the process of running the model, it is very dependent on GPU computing resources. Moreover, the isomorphism of the data will lead to the oscillation of the optimization results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Topology Optimization Method for Wireless Sensor Networks Based on Asynchronous Deep Reinforcement Learning
  • Topology Optimization Method for Wireless Sensor Networks Based on Asynchronous Deep Reinforcement Learning
  • Topology Optimization Method for Wireless Sensor Networks Based on Asynchronous Deep Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The specific mode, structure, characteristics and functions of the wireless sensor network topology optimization method designed according to the invention are described in detail below in combination with the attached drawings.

[0019]Step 1: use the rules of scale-free network model to generate the initialized wireless sensor network topology X. The network topology nodes are randomly deployed, and the nodes newly added to the wireless sensor network are connected according to the edge density parameter M. The newly added nodes are preferentially connected with the existing nodes, so as to ensure that the wireless sensor network can describe the network topology characteristics of the real world to the greatest extent, and fix the geographical location P of the node at the same time. Each node has the same attributes.

[0020] Where the edge density parameter is set to M = 2, which means that the number of edges in the wireless sensor network is twice the number of nodes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a wireless sensor network topology optimization method based on asynchronous deep reinforcement learning, which utilizes the rules of a scale-free network model to generate an initialized wireless sensor network topology structure; compresses the wireless sensor network topology structure; initializes an asynchronous deep reinforcement learning model; trains and testing stage; in the training stage, first serialize the wireless sensor network topology, and use a row vector to represent the wireless sensor network topology; then, the network topology row vectors are respectively input into different local network training models; secondly , the local network training model contains two neural network models, namely the action selection strategy network and the strategy evaluation network; in the testing phase, the global network training model evaluates the test data set; repeat steps 1, 2, 3 and 4; until The maximum number of iterations.

Description

technical field [0001] The invention mainly relates to the technical field of wireless sensor networks, in particular to a wireless sensor network topology optimization method based on asynchronous deep reinforcement learning. Background technology [0002] As an important part of the smart city Internet of things, wireless sensor network plays an important role in obtaining information in real time, which can make people get more information they want. By analyzing these data, we can improve the service quality of smart city and help people deal with some emergencies. Wireless sensor networks are widely used, such as smart home, smart wearable devices, intelligent transportation, environmental monitoring, homeland security, border detection and so on. The premise of the above application is that the network has high robustness, can send the sensed data to the server data center through the network, and relevant personnel or systems can carry out subsequent emergency handling str...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04W16/18H04W84/18H04W24/02H04W24/06G06K9/62G06N3/08
CPCH04W16/18H04W24/02H04W24/06G06N3/08H04W84/18G06F18/214
Inventor 邱铁陈宁李克秋周晓波赵来平张朝昆
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products