Automobile longitudinal multi-state control method based on deep reinforcement learning priority extraction

A technology that reinforces learning and control methods, applied in design optimization/simulation, instrumentation, geometric CAD, etc., can solve problems such as inability to apply to various driving environments, sensor misjudgment, manual control, etc., to achieve good control stability and good control. Smooth, efficient effect

Active Publication Date: 2021-05-28
HEFEI UNIV OF TECH
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The adaptive cruise system uses radar and other sensors to obtain road data ahead, and maintains a certain distance and speed from the vehicle in front according to the corresponding algorithm, but the adaptive cruise system is often turned on at a higher speed, such as above 25km/h, below this speed It requires manual control by the driver; the emergency braking system refers to a technology ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automobile longitudinal multi-state control method based on deep reinforcement learning priority extraction
  • Automobile longitudinal multi-state control method based on deep reinforcement learning priority extraction
  • Automobile longitudinal multi-state control method based on deep reinforcement learning priority extraction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058]In this embodiment, a longitudinal polymorphic control method based on deep reinforced learning priority can decide the throttle opening degree and the main cylinder pressure of the car corresponding time according to the real-time state parameters of the car, thereby completing the car in high-speed state. Car driving, adaptive cruise, medium speed state emergency brake, low speed status - stopped polymorphism, specifically, as follows:

[0059]Step 1: Establish a vehicle dynamics model and vehicle driving environment model using Carsim software;

[0060]Step 2: Collect the car driving data in the real driving scene and act as an initialization data, the car driving data is the initial state information of the vehicle and the initial control parameter information of the vehicle;

[0061]Step 3: Define the status information set of the vehicle S = {S0, S1, ... st, ..., sn}, S0Indicates the initial status information of the vehicle, StIndicates that the vehicle is in the state St-1That ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automobile longitudinal multi-state control method based on deep reinforcement learning priority extraction. The method comprises the following steps: 1, defining a state parameter set s and a control parameter set a of automobile driving; 2, initializing deep reinforcement learning parameters, and constructing a deep neural network; 3, defining a deep reinforcement learning reward function and a priority extraction rule; 4, training the deep neural network and obtaining an optimal network model; and 5, obtaining a t moment state parameter st of the automobile, inputting the t moment state parameter st into the optimal network model to obtain an output at, and executing the output at by the automobile. According to the method, the multi-state driving of the automobile in the longitudinal direction is completed by combining the priority extraction algorithm and the deep reinforcement learning control method, so that the safety of the automobile in the driving process is higher, and traffic accidents are reduced.

Description

Technical field[0001]The present invention relates to the field of longitudinal polymorphic control of smart vehicles, and is specifically a vehicle longitudinal polymorphic control method based on deep strengthening learning priority.Background technique[0002]With the rapid development of urban economy and the continuous improvement of people's living standards, the number of urban motor vehicles has also increased significantly, and the car has become an indispensable step-by-step tool, bringing fast and convenient, and also brings a series Security Question. Due to the limited number of technical capabilities of the driver or other uncontrollable external factors, traffic issues such as two cars or multi-cars often occur, while bringing the loss of life and property, it also caused great difficulties to the road. With the continuous development of automotive related technologies, many car companies have introduced adaptive cruise systems and emergency braking systems. The adaptiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F30/15G06F30/17G06F30/27G06F119/14
CPCG06F30/15G06F30/17G06F30/27G06F2119/14Y02T10/40
Inventor 黄鹤吴润晨张峰王博文于海涛汤德江张炳力
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products