The invention relates to a multi-peak target tracking method with fusion of background information. According to the method, the background information near the target is utilized, the background information of the same size is extracted from eight concrete positions of upper left, upper, upper right, left, right, lower left, lower and lower right of a current frame target search box to act as candidate target search boxes, the response of the candidate target boxes is computed by using the circulation matrix of the correlation filter tracking method and the Gaussian kernel function, and the classifier parameters are trained and updated so that the success rate in case of rotation change of the target can be enhanced. Existence of the interference situation of similar targets is considered, and the multi-peak target detection strategy, i.e. the possibility that the target is located in any one of multiple peaks of the target output response diagram, is utilized so that the accuracy oftarget tracking can be enhanced.