Pedestrian detection method based on spatio-temporal context information

Abstract

The invention discloses a pedestrian detection method based on double-layer spatio-temporal context information. The method includes the steps: firstly, performing dimension estimation for an original image to obtain an interested area; then, extracting the double-layer spatio-temporal context information by extracting characteristic-layer spatio-temporal context, instance-layer spatio-temporal context and instance-layer timing sequence context so as to extract apparent characteristics to construct a basic pedestrian detector; and finally, combining the double-layer spatio-temporal context information with the apparent characteristics by the aid of a spatio-temporal context model. On the basis of the basic pedestrian detector based on the apparent characteristics, the double-layer spatio-temporal context information relevant to pedestrian detection is extracted automatically, and the apparent characteristics and the double-layer spatio-temporal context information are combined by the aid of the spatio-temporal context model. The double-layer spatio-temporal context information is introduced, influences of a complicated background and local blocking on detection performance are effectively overcome, and pedestrian detection recall rate is increased while pedestrian detection precision is improved.

Description

technical field [0001] The invention relates to a pedestrian detection method in the field of surveillance video and intelligent transportation, in particular to a video-based pedestrian detection method. Background technique [0002] Context information is all information that is not directly obtained through object appearance, which can be used as an effective auxiliary method to improve the performance of object detection. According to context information extraction, intra-frame or inter-frame information can be used, which can be divided into spatial context and temporal context; according to context information extraction, it is aimed at the object as a whole or image features, and context information can be divided into instance layer and feature layer. [0003] The core of the detection method based on context information is how to extract sufficient and effective context information, and how to combine it reasonably with the original appearance feature detector. Mos...

AI Technical Summary

Problems solved by technology

This method does not combine stereo vision information and does not describe the spatio-temporal context at the feature level, the spatio-temporal information extraction is relatively rough, and this method relies on foreground extraction, which is not suitable for vehicle application scenarios

Images