Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human face critical organ contour characteristic points positioning and tracking method and device

A technology for key organs and outer contours, applied in instruments, character and pattern recognition, computer components, etc., can solve problems such as the inability to accurately locate the outer contours of human faces and eyes, and the inability to accurately track outer contour points

Active Publication Date: 2011-10-12
BEIJING VIMICRO ARTIFICIAL INTELLIGENCE CHIP TECH CO LTD
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the method in the above-mentioned patent application cannot accurately locate the outer contours of the eyes, eyebrows and mouth of the human face, nor can it accurately track the outer contour points of these key organs of the human face. Therefore, applying it to two-dimensional and three-dimensional human There are certain limitations in face pose estimation and face animation synthesis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human face critical organ contour characteristic points positioning and tracking method and device
  • Human face critical organ contour characteristic points positioning and tracking method and device
  • Human face critical organ contour characteristic points positioning and tracking method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044]Systems such as 2D and 3D face pose estimation and face animation synthesis based on input video can synthesize face eyes and mouth in real time, and simulate various movements of mouth and eyes on the face model. However, the system must be based on the precise positioning of the outer contours of the face's eyes and mouth. It is possible to obtain stable and vivid two-dimensional and three-dimensional face synthesis results, and generate realistic facial animation.

[0045] The embodiment of the present invention proposes a method and device for locating and tracking key facial organ outline feature points on the basis of the positioning and tracking results of the corners of the eyes and the corners of the mouth. The method and device can be used to locate the feature points of the human face's eyes, eyebrows and mouth outline in real time from the video image input by the camera equipment, for example, 20 feature points can be located, such as figure 1 shown, and co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for positioning and tracking outer contour feature points of key face organs and a device thereof, comprising the following steps: first, the positions of canthi points and angulus oris points on the face are obtained; the medial axis of the eyes and the mouth is identified based on the positions; the outer contour feature points of the eyes and eyebrows are identified on the medial axis of the eyes, and the outer contour feature points of the mouth are identified on the medial axis of the mouth. Consistent positioning and tracking of outer contour feature points of key face organs are conducted on such a basis. The technical proposal provided by the embodiment of the invention solves the problem of inaccurate positioning of outer contour feature points ofeyes, mouth and eyebrows when people makes various faces; based on the positioning of the feature points, the existing two-dimensional and three-dimensional face models can be real-time driven, and face expressions and motions such as frowning, blinking and mouth opening of people before a camera can be real-time simulated, thus creating various real and vivid face animations.

Description

technical field [0001] The invention relates to the technical field of computer image processing, in particular to a method and device for locating and tracking feature points on the outer contours of key organs of a human face. Background technique [0002] At present, in the face detection and localization technology, it can be roughly divided into organ-based detection and localization methods and template-based detection and localization methods. The organ-based method regards the human face as a combination of salient organs, first extracts some important organs: eyes, nose, lips, etc., and then detects the face through the position of the organs and the geometric relationship between them. The performance of face key organ localization largely affects the accuracy of face detection methods. [0003] Traditional methods based on Active Appearance Models (AAM, Active Appearance Models) and Active Shape Models (ASM, Active Shape Models) generally use training models to l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
Inventor 黄英谢东海邓亚峰
Owner BEIJING VIMICRO ARTIFICIAL INTELLIGENCE CHIP TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products