Face tracking method and system based on deep learning

Abstract

The invention discloses a face tracking method and system based on deep learning, and the method comprises the steps: S1, obtaining a starting frame of a video stream as a current frame, and setting n= 0; s2, judging whether the current frame n of the video stream meets the condition that n% N is equal to 0 or not, if so, executing the step S3, and if not, executing the step S4, wherein N is a preset interval frame number; s3, performing face detection on the current frame, if a face is detected, outputting a face candidate box, and executing the step S4, otherwise, obtaining the next frame of the video stream as the current frame, setting n to be equal to 0, and executing the step S2; s4, performing face verification on the face candidate box, verifying whether the face candidate box contains a face or not, if so, outputting a face frame image, and executing the step S5, otherwise, obtaining a next frame of the video stream as a current frame, setting n to be equal to 0, and executing the step S2; s5, performing key point positioning on the face frame image, and calculating an external rectangular frame of a face key point; and S6, expanding the external rectangular frame to obtain an expanded rectangular frame, extracting a next frame of the video stream as a current frame, setting n = n + 1, setting the expanded rectangular frame as a face candidate frame, and executing thestep S2. The method is compatible with single-face and multi-face tracking, is not influenced by a scene environment, and is high in face tracking robustness and high in real-time performance.

Description

technical field [0001] The invention relates to the field of image processing, in particular to a deep learning-based face tracking method and system. Background technique [0002] In recent years, there have been more and more studies on face analysis. The so-called face analysis refers to the recognition of human expressions, locations, and identities based on the human face through computer vision and pattern recognition theory. Face tracking and face recognition are important links in face analysis, and through the cooperation of other links, the entire face analysis process can be effectively completed. Face analysis has come a long way, and it is well used in surveillance systems. Face tracking is the process of determining the motion trajectories and scale changes of one or more faces in a video stream or image sequence. Face tracking has great significance in the fields of image recognition analysis and target tracking, and has been the focus of attention in the fi...

AI Technical Summary

Problems solved by technology

The present invention is compatible with single-face and multiple-face tracking, and is not affected by the scene environment; the robustness of face tracking is high, and problems such as mistracking and lost tracking are solved; the mobile terminal of the present invention has strong real-time performance, the tracking speed can reach 100FPS, The method is very easy to implement on the mobile product side

Images