Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Traffic signal lamp control method and system based on reinforcement learning

A traffic signal and signal light control technology, applied in traffic control system, traffic control system of road vehicles, control of traffic signals, etc., can solve problems such as dependence on serious human intervention factors

Pending Publication Date: 2021-09-10
HUNAN UNIV
View PDF8 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the fact that the existing adaptive traffic signal light control method and system rely heavily on historical data and models and have large human intervention factors, which are not real adaptive control problems, the present invention proposes an adaptive traffic signal light control method and system based on reinforcement learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Traffic signal lamp control method and system based on reinforcement learning
  • Traffic signal lamp control method and system based on reinforcement learning
  • Traffic signal lamp control method and system based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0065] A traffic light control method based on reinforcement learning, such as figure 2 shown, including the following steps:

[0066] Step 1: Establish the signal light control Agent model, such as figure 1 shown.

[0067] The hybrid signal light control Agent model based on Belief-Desire-Intention (BDI) theory can interact with the changing external environment in real time, dynamically and autonomously, perceive and act on the environment, and Through the implementation of their own behavior to achieve the purpose of alleviating traffic congestion.

[0068] Step 2: Establish models of road intersections, roads, and signal lights.

[0069] The road network model was constructed using netedit 1.7.0, the accompanying software of SUMO. The road intersection is composed of four roads in the southeast, northwest, and there is a traffic signal light a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a traffic signal lamp control method and system based on reinforcement learning, and the method comprises the steps: firstly building a signal lamp control Agent model, then building a road and road intersection model, enabling the road traffic state information to be represented as a speed, position and current signal lamp state matrix, then, on the basis of traditional Q-Learning, establishing a traffic signal lamp control algorithm based on Deep Q Network (DQN) according to the road environment information; and finally, obtaining real-time road condition information through interaction between the Agent and the environment, performing search self-learning in a behavior space, estimating Q values for executing all possible actions in the current state, and selecting the action with the larger Q to be executed by utilizing an epsilon-greedy strategy. An existing traffic signal lamp control method is improved, the waiting time of vehicles at the intersection is minimized, the effective green light time of a signal control period is maximized, the vehicles are assisted to rapidly pass through the intersection, the passing time is shortest, meanwhile, the maximum traffic flow exists at the intersection, and thus the purpose of relieving traffic jam is achieved, and adaptive control of the traffic signal lamp is realized.

Description

technical field [0001] The invention relates to the technical field of intelligent traffic control, in particular to a traffic signal light control method and system based on reinforcement learning. Background technique [0002] With the rapid growth of the number of motor vehicles, the carrying capacity of urban road traffic is obviously insufficient, and the problem of traffic congestion has become increasingly prominent. In the urban road traffic system, the traffic flow at each intersection is interrelated and affected, and the traffic congestion at a certain phase of any intersection will cause the adjacent phase to also be congested, and then lead to adjacent intersections and Areas can also be congested. In recent years, traffic congestion has attracted more and more people's attention. There are two main ways to alleviate traffic congestion: one is to strengthen infrastructure construction, such as improving the traffic capacity of the road network, expanding bridge...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G08G1/07G08G1/01G06N20/00
CPCG08G1/07G08G1/0125G06N20/00
Inventor 罗娟郑燕柳
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products