The invention discloses a width learning-based long-term target tracking algorithm. The algorithm comprises the following steps of: establishing a width learning system; and carrying out tracking on the basis of the width learning system and establishing an acceleration steady feature algorithm-based whole-image detection mechanism. According to the algorithm, width learning system-based long-termtarget tracking is carried out, width learning architecture is relatively shallow in layer and relatively low requirement is put forward for calculation resources, so that deployment can be carried out on low-end equipment without losing great precision. According to the algorithm, an obtained target tracking model is high in training speed, small in reconstruction cost and low in time cost, andhas great superiority for detection of deformation, rotation and shielding in target tracking process. According to the algorithm, the SURF algorithm-based whole-image detection mechanism is applied,so that target information can be rapidly obtained when targets re-appear under the condition that the width learning system judges that the targets are lost, and the target positions can be updated so as to ensure that the tracking effect is more stable, robust and reliable.