The invention discloses a dividing method of moving object in video sequence. Aiming at resolving problem of current technique is affected by speed of object, shadow effect, background miscarriage of justice. The dividing method of moving object in video sequence is analyzing current frame gray image and former frame gray image, global movement estimation, modality filter, edge examination, movement object examination and post treatment, background image generation, global movement compensation, commutation scene examination, movement object track, background image renewal, by adopting said method, lesser calculation quality can overcome disadvantageous factors of shadow effect, background miscarriage of justice, better result can be obtained.