Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for tracking gestures and actions of human face

A face pose and motion technology, applied in character and pattern recognition, image data processing, instruments, etc., can solve the problems of large amount of calculation and difficulty in meeting real-time requirements, and achieve the effect of fast tracking speed and good generalization performance

Inactive Publication Date: 2012-04-04
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF2 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, a big problem with this type of method is that the amount of calculation is too large to meet the real-time requirements.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for tracking gestures and actions of human face
  • Method for tracking gestures and actions of human face
  • Method for tracking gestures and actions of human face

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be described in detail below in conjunction with the accompanying drawings. It should be noted that the described embodiments are only intended to facilitate the understanding of the present invention, rather than limiting it in any way.

[0033] see figure 1 The automatic facial expression analysis method based on motion tracking is shown, implemented according to the following steps:

[0034] 1. Face detection

[0035] The purpose of human face detection is to automatically detect the position of human face in the image, and the present invention utilizes adaptive promotion (Adaboost) algorithm to carry out human face automatic detection. Adaptive boosting is a commonly used statistical learning algorithm that has been successfully applied to face detection and face classification. Adaptive boosting sets a weight for each training sample, and iteratively modifies the weight of the sample, appropriately reducing the weight of correctly clas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for tracking gestures and actions of a human face, which comprises steps as follows: a step S1 includes that frame-by-frame images are extracted from a video streaming, human face detection is carried out for a first frame of image of an input video or when tracking is failed, and a human face surrounding frame is obtained, a step S2 includes that after convergent iteration of a previous frame of image, more remarkable feature points of textural features of a human face area of the previous frame of image match with corresponding feather points found in a current frame of image during normal tracking, and matching results of the feather points are obtained, a step S3 includes that the shape of an active appearance model is initialized according to the human face surrounding frame or the feature point matching results, and an initial value of the shape of a human face in the current frame of image is obtained, and a step S4 includes that the active appearance model is fit by a reversal synthesis algorithm, so that human face three-dimensional gestures and face action parameters are obtained. By the aid of the method, online tracking can be completed full-automatically in real time under the condition of common illumination.

Description

technical field [0001] The invention relates to the fields of image processing and computer vision, in particular to an image-based human face pose and motion tracking method. Background technique [0002] Estimating and tracking the pose and facial movements of faces in images or videos has important application value in the fields of human-computer interaction, virtual reality, intelligent monitoring, multi-pose face recognition and expression recognition. For example, in the facial expression animation system based on video, a virtual person or cartoon image can be driven to make similar facial expressions according to the head posture and facial movements extracted from the video, which has a wide range of applications in digital interactive entertainment, animation production and other industries. application value. [0003] According to the different information used by the tracking algorithm, the face tracking method can be divided into a feature-based method (Featur...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/64G06T7/20
Inventor 王阳生周明才
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products