Method for selecting relay node in M2M communication based on reinforcement learning

A technology of relay node and reinforcement learning, which is applied in the field of relay node selection and relay node selection in M2M communication, can solve problems such as energy imbalance and shortening the service life of the system, so as to prolong the service life, avoid energy imbalance and reduce energy The effect of consumption

Active Publication Date: 2020-06-05
NANJING UNIV OF POSTS & TELECOMM
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] When implementing these existing relay node selection methods, technicians found that relay nodes with better channel conditions in the entire wireless communication network will be frequently selected for use For information transmission, the energy of the battery powering it will be consumed faster than other relay nodes, resulting in an energy imbalance within the system and shortening the service life of the entire system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for selecting relay node in M2M communication based on reinforcement learning
  • Method for selecting relay node in M2M communication based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The present invention discloses a method for selecting a relay node in M2M communication based on reinforcement learning. The solutions of the present invention will be further described below in combination with embodiments.

[0060] The overall idea of ​​the present invention is as follows: Utilizing the characteristics of low mobility of M2M communication equipment, according to the channel conditions from each relay node to M2M communication equipment and the channel conditions from source node to each relay node, the method of decoding and forwarding (Decode and Forward) is adopted Calculate the energy consumed by selecting each relay node in a single communication. Then the selection of the relay node is taken as the action in the reinforcement learning, and the energy consumed by a single communication is combined with the balance of the battery energy of each relay node as the reward in the reinforcement learning. Taking the remaining battery energy of each rela...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for selecting a relay node M2M communication based on reinforcement learning. The method comprises the following steps: S1, building a reinforcement learning model framework, and determining an action set, a state set and a reward value of reinforcement learning; S2, refining the reinforcement learning model framework; S3, performing iterative loop on the reinforcement learning model according to a specific problem; and S4, adjusting the reinforcement learning model according to a training result, and selecting the relay node by using the adjusted reinforcementlearning model. The energy consumption condition of each communication and the energy balance condition of the battery for supplying energy to the relay node are both brought into the reinforcement learning target, so that the system achieves balance in reducing the energy consumption and realizing the energy balance, the energy unbalance is avoided, and the service life of the whole system is prolonged.

Description

technical field [0001] The invention relates to a relay selection method, in particular to a method for selecting relay nodes in M2M communication based on reinforcement learning for battery-powered relay selection, and belongs to the technical field of wireless communication. Background technique [0002] In recent years, with the continuous development of computer technology, machine learning (Machine Learning) has gradually become the core technology of artificial intelligence, and has received extensive attention from many researchers in the industry. [0003] Specifically, according to whether there are labels in the sample data in its database, machine learning can be roughly divided into three types: supervised learning, unsupervised learning, and reinforcement learning. Among them, reinforcement learning is a learning method that takes environmental feedback as input and is guided by statistics and dynamic programming techniques. Reinforcement learning is inspired b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04W4/70H04W40/02H04W40/10H04W40/12H04W40/22
CPCH04W4/70H04W40/02H04W40/10H04W40/12H04W40/22Y02D30/70
Inventor 潘甦吴子秋
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products