Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Reinforcement learning-based named data network congestion control method

A named data network and reinforcement learning technology, applied in the field of network information transmission and communication, to reduce the average network delay, increase the data delivery rate, and reduce the number of lost packets.

Active Publication Date: 2018-11-23
BEIJING INSTITUTE OF TECHNOLOGYGY +1
View PDF6 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The purpose of the present invention is to overcome the defects of the existing NDN congestion control technology, aiming at NDN’s unique PULL-based communication mechanism and content-centric routing and forwarding strategy, and considering the impact of the cache in the node, a method based on reinforcement learning is proposed. Congestion Control Method for Named Data Networks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reinforcement learning-based named data network congestion control method
  • Reinforcement learning-based named data network congestion control method
  • Reinforcement learning-based named data network congestion control method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0066] The network topology of this embodiment is as follows Figure 4 shown. In the simulation setting, there are 9 network nodes in total, including 4 content requesters, 4 routers (intermediate forwarding nodes) and 1 content producer. The bandwidth and delay settings of each link are shown in Table 1. Router1 and Router2 have a relatively good and relatively poor output link respectively: Router1-Router4 is a better output link. Compared with Router1-Router3, this link has larger bandwidth and smaller delay , more data is transmitted per unit time. The two output links corresponding to Router2 are the same, but generally better than the output link of Router1.

[0067] Table 1 Link setting table

[0068]

[0069]

[0070] In this embodiment, the proposed intelligent forwarding strategy is compared with the best routing algorithm Best Route, the multi-path forwarding algorithm Multicast, and the request forwarding algorithm (Request Forwarding). In the simulation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a reinforcement learning-based named data network congestion control method and belongs to the network information transmission communication technical field. According to thereinforcement learning-based named data network congestion control method of the invention, from the perspective of a forwarding strategy, the process of the forwarding of an interest packet by a routing node is mapped into a Markov decision-making process; with minimum response time adopted as an objective, intra-network buffer and multi-path forwarding in an NDN (named data network) are considered; a reinforcement learning method is used to solve an optimal strategy under a condition that any assumptions about link capacity or packet size are not made; in the reinforcement learning solutionmethod, a Sarsa algorithm based on eligibility traces, namely the Sarsa(lambda) algorithm, is used to realize theoretically good algorithm performance; a dynamic forwarding policy is adopted to intelligently select a forwarding port, and therefore, a condition that traffic is sent to a congested link can be avoided as much as possible, and congestion can be actively avoided and alleviated.

Description

technical field [0001] The invention relates to a network congestion control method, in particular to a named data network congestion control method based on reinforcement learning, which belongs to the technical field of network information transmission and communication. Background technique [0002] As one of the future-oriented network architectures, Named Data Networking (NDN) fundamentally solves today's TCP / IP (Transmission Control Protocol / Internet Protocol, Transmission Control Protocol / The contradiction between the host-centric communication mode in the Internet Protocol (Internet Protocol) network and the user's content-centric network requirements. [0003] The occurrence of congestion is closely related to the architecture of the network itself. The proposal of congestion control mechanism is based on a specific network. In TCP / IP, the connection is established between end-to-end, and two communicating hosts will form a fixed link, and congestion control can ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/801H04L12/947
CPCH04L47/12H04L49/252
Inventor 张宇郭彦涛王亚东安旭溟陈延祥安建平卜祥元
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com