The invention relates to an
infrared behavior identification method based on adaptive fusion of an artificial design feature and a depth learning feature. The method comprises: S1, improved dense track
feature extraction is carried out on an original video by using an artificial design feature module; S2,
feature coding is carried out on the extracted artificial design feature; S3, with a CNN feature module, optic flow
information extraction is carried out on an original
video image sequence by using a variation optic flow
algorithm, thereby obtaining a corresponding optic flow
image sequence; S4, CNN
feature extraction is carried out on the optic flow sequence obtained at the S3 by using a
convolutional neural network; and S5, a
data set is divided into a
training set and a testing set; and weight learning is carried out on the
training set data by using a weight optimization network, weight fusion is carried out on probability outputs of a CNN feature classification network and an artificial design feature classification network by using the learned weight, an
optimal weight is obtained based on a comparison identification result, and then the
optimal weight is applied to testing set
data classification. According to the method, a novel
feature fusion way is provided; and reliability of behavior identification in an
infrared video is improved. Therefore, the method has the great significance in a follow-up video analysis.