Network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning

A technology of reinforcement learning and signal lights, applied in vehicle wireless communication services, services based on location information, services based on specific environments, etc., can solve the problems of convenient application and research of ecological driving strategies that are not yet mature, and achieve the effect of good generalization ability

Active Publication Date: 2021-08-17
SOUTHEAST UNIV
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The Actor-Critic architecture can directly output action information and has powerful optimization capabilities. The research on the convenient application of ecological driving strategies is not yet mature

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning
  • Network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning
  • Network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The specific embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0055] In this embodiment, a network-connected vehicle signal light-controlled intersection economical passage method based on reinforcement learning can be referred to figure 1 , the computing system based on it includes an information acquisition module, an environment model module, and a vehicle speed optimization module. The information acquisition module includes obtaining roadside unit information and vehicle operating status information based on wireless short-wave communication or 5G\LTE protocol communication OBU / RSU; environment model The module includes building a vehicle model, roadside signal lights and the traffic environment model of the vehicle in front; the vehicle speed optimization module includes using deep reinforcement learning algorithms to construct a pure electric vehicle signal light control intersection traffic strategy, an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning. The method comprises the following steps that vehicle and roadside environment state information is obtained; an intersection passage ecological driving model is built, includes building a vehicle longitudinal dynamics model and building a roadside signal lamp state traffic environment model; a deep deterministic strategy gradient algorithm is utilized to construct a pure electric network connection vehicle intersection passing ecological driving strategy, a multi-objective optimization problem including the minimum vehicle battery energy consumption and the shortest passing time is solved, an optimal passing speed spectrum is obtained, and therefore the optimal energy consumption level of passing through an intersection is obtained. According to the invention, the deep reinforcement learning algorithm is applied to actual vehicle intersection traffic control, and the method has good generalization performance and optimization effect for a signal lamp remaining time dynamic change scene.

Description

technical field [0001] The invention relates to the technical field of smart traffic and intelligent networked vehicle control, in particular to a method for economical crossing traffic controlled by signal lights of networked vehicles based on reinforcement learning. Background technique [0002] The rapid development of urbanization has brought great challenges to the road traffic environment, and the increasingly crowded traffic intersections with signal lights have generated a lot of unnecessary energy consumption. The entry and exit of economical intersections has always been the main research focus of traffic decision-making in urban traffic intersections. From the perspective of vehicles, the emergence of intelligent networked vehicles provides a new solution to improve traffic efficiency and alleviate the phenomenon of parking and waiting at urban light-controlled intersections. In addition to being driven by new energy, smart electric vehicles are based on the low-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G08G1/01G08G1/0967G07C5/08H04W4/02H04W4/44G06F30/20
CPCG08G1/0112G08G1/0116G08G1/0125G08G1/0137G08G1/096783G07C5/0808G07C5/0841H04W4/025H04W4/027H04W4/44G06F30/20Y02D30/70
Inventor 殷国栋丁昊楠董昊轩
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products