Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Attention mechanism-based pedestrian trajectory prediction method

A trajectory prediction and attention technology, applied in computer parts, image analysis, image enhancement, etc., can solve problems such as the inability to correctly simulate the motion state of pedestrians, the disappearance of the gradient of the recurrent neural network, and the long running time of the model, so as to shorten the prediction time. Time, avoid gradient disappearance, the effect of fast operation

Pending Publication Date: 2021-07-23
BEIJING UNIV OF TECH
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Existing technical defects: the current method ignores the influence of pedestrian intentions on motion, resulting in the inability to correctly simulate the motion state of pedestrians; the current encoding module is limited to using a recurrent neural network to encode the position information of pedestrians at the current moment
However, the cyclic neural network contains a large number of repeated calculations, which leads to the long running time of the model, and the cyclic neural network has problems such as gradient disappearance and gradient explosion.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Attention mechanism-based pedestrian trajectory prediction method
  • Attention mechanism-based pedestrian trajectory prediction method
  • Attention mechanism-based pedestrian trajectory prediction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] refer to figure 1 , an attention-based pedestrian trajectory prediction method, the method includes three modules, an individual attention encoding module, a social attention pooling module and a gated recurrent unit decoding module. The method uses the attention mechanism in both the individual attention encoding module and the social attention pooling module, and the attention mechanism is called the individual attention mechanism and the social attention mechanism respectively. At the same time, the method uses gated recurrent units in two places, the social attention pooling module and the gated recurrent unit decoding module, and the gated recurrent units are called pooling gated recurrent units and decoding gated recurrent units respectively.

[0026] The forecasting process mainly includes the following steps:

[0027] 1. Obtain a piece of video, divide the video into several frames at an interval of 0.4s, and obtain the trajectory coordinates of each pedestrian...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an attention-based pedestrian trajectory prediction method, which is used for more accurately and quickly predicting a future trajectory of a pedestrian. The invention specifically comprises three modules: an individual attention coding module used for calculating similarity of hidden vectors in a historical trajectory of a pedestrian and outputting an individual attention feature matrix so as to obtain main influence factors of the pedestrian in a motion process; the social attention pooling module that is used for receiving a calculation result, namely an individual attention feature matrix, of the individual attention coding module, calculating the similarity of hidden vectors in historical tracks of all pedestrians in a scene and outputting a comprehensive motion feature matrix so as to obtain a mutual influence relationship among the pedestrians in a motion process; the gating circulation unit decoding module that is used for receiving a calculation result of the social attention pooling module, namely a comprehensive motion characteristic matrix, and calculating and outputting future trajectory coordinates of pedestrians by utilizing a gating circulation unit. The method effectively improves the prediction precision and speed.

Description

technical field [0001] The invention relates to the fields of computer vision technology and automatic driving, and is a pedestrian trajectory prediction method based on an attention mechanism. Background technique [0002] Pedestrian trajectory prediction is one of the important research directions in computer vision applications. The research results can be widely used in pedestrian avoidance, automatic navigation, street planning, automatic driving and other fields. The trajectory prediction problem can be regarded as a sequential problem, that is, to predict the future trajectory of pedestrians based on their historical trajectories in the scene. Because the pedestrian motion is flexible and the interactive motion between pedestrians is complex and abstract, the main challenge of pedestrian trajectory prediction is how to accurately find the motion law of pedestrians and model the interactive motion between pedestrians. [0003] In pedestrian trajectory prediction, most...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06T7/73G06K9/62
CPCG06T7/246G06T7/73G06T2207/30241G06F18/22Y02T10/40
Inventor 杨金福闫雪李明爱李亚萍李智勇
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products