The invention discloses a moving vehicle detection method including a pause state in an aerial photograph video of an unmanned aerial vehicle. At first, multilevel preprocessor is used to preprocess that image, as the image is filtered and denoised, the aim of this paper is to improve the characteristics of uneven illumination in aerial video of unmanned aerial vehicles, the entropy rate superpixel segmentation algorithm with superpixel regularity is then used to extract the superpixels from the image, dictionary learning algorithm based on correlation and double sparsity obtains the color ofsuper pixel, texture, geometry, a fusion similarity matrix is constructed for image segmentation, using the texture and geometric features of the RAG fusion region of successive multi-frame images toperform image matching, the motion information of the RAG fusion region is obtained. Furthermore, an image foreground and background segmentation method based on a motion similarity map are proposed to realize the detection of a moving vehicle with a pause state, thereby greatly reducing the difficulty of detecting the moving vehicle. The algorithm of the invention is simple and quick, and can effectively detect the moving vehicle with a pause state in a video shot by an unmanned aerial vehicle.