Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face tracking method and system based on multi-feature fusion

A multi-feature fusion, face technology, applied in the field of face tracking methods and systems based on multi-feature fusion, can solve problems such as time-consuming, affecting tracking accuracy, missing matching, etc. The effect of ensuring speed and strong expression ability

Active Publication Date: 2021-01-12
BEIJING ICHINAE SCI & TECH CO LTD
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this invention performs face detection and feature extraction on each frame of image, which takes a lot of time. When matching, only the depth feature is used to search and match within a certain position range, which is likely to cause missing matching, resulting in ID switching and affecting Tracking Accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face tracking method and system based on multi-feature fusion
  • Face tracking method and system based on multi-feature fusion
  • Face tracking method and system based on multi-feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Embodiment one, a kind of face tracking method based on multi-feature fusion, such as figure 1 shown, including the following steps:

[0057] S1) Obtain the target image of the current frame of the video or picture stream.

[0058] In this embodiment, the video or picture stream includes multiple frames of continuous images, and the images in it are sequentially taken from the initial frame for processing. The picture fetching operation can be completed by an image codec library such as OpenCV, etc., wherein the frame number f of the initial frame is 0, the frame number of each subsequent frame increases by 1.

[0059] S2) Obtain all existing face tracks, use the Kalman filter method to predict the position coordinates of the face track frames of all stored face tracks in the current frame target image, and each stored face track corresponds to a Kalman filter , a Kalman filter corresponds to predicting the position coordinates of the face track frame of an existing f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of intelligent video image processing, and discloses a face tracking method and system based on multi-feature fusion, and the method comprises the steps of obtaininga current frame target image; predicting face trajectory frame position coordinates of all stored face trajectories in the current frame of target image by using a Kalman filtering method; judging whether the frame number of the current frame of target image is a multiple of the detection interval; judging whether a human face is detected or not; performing feature extraction on the face rectangular frame by using a feature extraction algorithm to obtain face features of all faces; carrying out face feature matching; carrying out secondary matching on the face which fails to be matched and the face track which fails to be matched; updating a Kalman filter and track information; determining whether to end face tracking. By setting the face detection interval, the processing speed of the system is high; the matching accuracy is high by fusing the depth features and the HOG features; and feature matching and IOU matching are used cooperatively, so that face ID switching is reduced, the continuity of tracking is ensured, and the accuracy of tracking is improved.

Description

technical field [0001] The invention relates to the field of intelligent video image processing, in particular to a face tracking method and system based on multi-feature fusion. Background technique [0002] The intelligent monitoring system cooperates with the face recognition system to complete tasks such as real-time investigation of dangerous personnel and fast tracking of suspects. The system obtains face images through face tracking and capture, and sends them to the face recognition module to complete face comparison. However, due to the complex and changeable monitoring scene, the face continues to move in the screen, and there are often situations such as illumination changes, blurring, occlusion, and face posture changes, which make it difficult to maintain the face tracking track, and the face ID of the same person is switched. Thus, the captured face pictures have many repetitions, which affects the processing efficiency of the system. [0003] For example, th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/161G06V40/168G06V10/751
Inventor 高珊珊瞿洪柱宋春晓袁丽燕
Owner BEIJING ICHINAE SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products