Fused automatic driving automobile street-crossing pedestrian trajectory prediction method and system

An automatic driving and trajectory prediction technology, which is applied in the field of pedestrian trajectory prediction of autonomous vehicles crossing the street and pedestrian trajectory prediction of integrated autonomous vehicles crossing the street, which can solve the problems of reducing vehicle traffic efficiency, reducing road capacity, and poor pedestrian trajectory accuracy.

Active Publication Date: 2020-07-28
SHANGHAI JIAO TONG UNIV
View PDF13 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The overly conservative intelligent decision-making behavior of self-driving cars in the face of pedestrians not only reduces the traffic capacity of the road, but may even cause road congestion
[0004] Existing pedestrian trajectory prediction methods, such as Momenta, currently use the simplest constant velocity (CV) model or constant acceleration (CA) model to predict the trajectory of pedestrians, in order to remind the driver whether there will be pedestrians suddenly breaking into the driving area. Accidents, but the model has low accuracy and poor implementation effect, so it is not suitable for self-driving cars that require extremely high accuracy
There is also a dynamic Bayesian network (DBN) used to predict the movement state of pedestrians crossing the street when facing an approaching vehicle (stop and go prediction). Efficiency; there is also the use of deep learning long-short-term memory network (LSTM) model to predict the trajectory of pedestrians. Although the prediction effect is good, it only considers the trajectory prediction of a single pedestrian in isolation, and does not consider vehicles, surrounding pedestrians and other traffic environments. Impact on Target Pedestrians
[0005] Although many achievements have been made in the trajectory prediction of pedestrians, the main problem in the prediction process of existing methods is that pedestrians are predicted as general obstacles, and the surrounding traffic environment cannot be considered from a sociological point of view. The impact on target pedestrians, such as the impact of surrounding pedestrians on target pedestrians, the impact of vehicles on target pedestrians, and the impact of traffic lights and zebra crossings on pedestrians, etc., will result in poor accuracy of predicted pedestrian trajectories
In addition, the influence of individual differences of pedestrians is rarely considered
At present, there is no pedestrian trajectory prediction method that considers factors such as the surrounding traffic environment and pedestrian personality differences.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fused automatic driving automobile street-crossing pedestrian trajectory prediction method and system
  • Fused automatic driving automobile street-crossing pedestrian trajectory prediction method and system
  • Fused automatic driving automobile street-crossing pedestrian trajectory prediction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0089] According to a kind of fused self-driving car crossing street pedestrian track prediction method provided by the present invention, comprise, such as figure 1 Shown:

[0090]Step M1: Obtain the motion state information of pedestrians crossing the street, individual feature information of pedestrians, and motion state information of autonomous vehicles within the range of the vehicle safety envelope through fusion algorithms based on on-board sensors;

[0091] Specifically, the step M1 includes: selecting pedestrians and vehicles in the zebra crossing area under free flow conditions for preliminary investigation, using self-driving cars equipped with laser, camera and / or millimeter-wave radar sensors, through multiple sensor information fusion algorithms , to obtain the movement state information (position, speed) of pedestrians crossing the street within the range of the vehicle safety envelope, the individual characteristic information of pedestrians (age, gender) and ...

Embodiment 2

[0176] Embodiment 2 is a modification of embodiment 1

[0177] The designed LSTM model has a network structure with one hidden layer, multiple inputs and multiple outputs. The input layer features 11, which are the speed (X, Y direction), position (X, Y direction) and age of pedestrians crossing the street respectively. and gender, as well as the vehicle's speed (X, Y direction), position (X, Y direction) and vehicle type, the gating unit in the hidden layer uses the sigmoid activation function, the input and output unit uses the tanh activation function, and the number of nodes in the hidden layer is set is 256, the output information of the output layer is the movement trajectory (X, Y direction) of the pedestrian crossing the street in the first preset duration in the future;

[0178] The LSTM unit includes three control gates, namely the input gate, the forget gate and the output gate, which are used to control the relationship between the input, output and the internal st...

Embodiment 3

[0209] Embodiment 3 is a modification of embodiment 1 and / or embodiment 2

[0210] Such as figure 2 As shown, for a zebra crossing without signal light control, pedestrians crossing the street walk on the zebra crossing along the east-west direction, and autonomous vehicles go straight along the north-south direction. Integrate the social force model and LSTM model to predict the trajectory of pedestrians crossing the street for autonomous vehicles;

[0211] Select several typical zebra crossings without signal light control, including human-vehicle interaction scenes and different types of pedestrians, and collect more than 12 hours of traffic flow videos of pedestrians and vehicles crossing the street.

[0212] Through the preprocessing of the shooting video, the real trajectory of pedestrians crossing the street for a period of time can be obtained, and the same walking scene of pedestrians crossing the street is set, and a certain initial value of the parameters of the s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a fused automatic driving automobile street-crossing pedestrian trajectory prediction method and system, and the method comprises the steps: obtaining street-crossing pedestrianmotion state information, pedestrian individual feature information and vehicle motion state information according to a vehicle-mounted sensor fusion algorithm; calibrating parameters in the social force model according to the state data obtained by the vehicle-mounted sensor; training structural weight and offset parameters of an LSTM model according to the state data obtained by the vehicle-mounted sensor; utilizing the social force model and the LSTM model to respectively predict the motion trails of pedestrians crossing the street; importing the motion trail predicted by the model and theactual trail truth value of the pedestrian crossing the street into a Stacking fusion model, and training a structure weight; and outputting the optimal prediction track of the pedestrian crossing the street within a first preset time length in the future by utilizing the Stacking fusion model. According to the method, the Stacking algorithm is used for fusing the social force model and the LSTMmodel, the effect of reducing variance and deviation is achieved, and therefore it is guaranteed that the predicted trajectory is closer to the actual trajectory of the pedestrian.

Description

technical field [0001] The present invention relates to the field of decision-making algorithms for automatic driving, in particular, to a method and system for predicting trajectories of pedestrians crossing the street for autonomous vehicles, and more specifically, to a trajectory of pedestrians crossing streets for autonomous vehicles, which integrates the social force model and the LSTM model The prediction method involves a whole set of processes from the preparatory work to the specific implementation method in the later stage. Background technique [0002] In recent years, with the rapid development of autonomous vehicle technology, pedestrian safety protection is an important factor that must be considered by autonomous vehicles. Pedestrians, as the main participants in traffic, are more complex and changeable than vehicle movements, and have great flexibility and randomness. For autonomous vehicles, understanding pedestrian behavior and predicting trajectories is a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/02G06K9/00G06N3/04G06N3/08
CPCG05D1/024G05D1/0253G05D1/0257G05D1/0223G06N3/08G06V40/20G06V20/56G06N3/044G06N3/045
Inventor 张希陈浩杨文彦金文强刘冶朱旺旺赵柏暄张凯炯刘磊
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products