Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-style face feature point detection method based on convolutional neural network

A convolutional neural network and face feature technology, applied in the field of multi-style face feature point detection based on convolutional neural network, can solve the problems of face multi-style neglect, face feature point detection error, dullness, etc., to achieve Reduce error, improve accuracy, and improve the effect of accuracy

Inactive Publication Date: 2020-04-17
HARBIN ENG UNIV
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the face feature point detection is easily affected by the multiple styles of the face and causes errors, such as grayscale images and color images, light and dark, strong contrast, dull contrast
At present, most of the face images used to train neural networks are from the wild, so the neglect of multiple styles of faces is becoming more and more serious.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-style face feature point detection method based on convolutional neural network
  • Multi-style face feature point detection method based on convolutional neural network
  • Multi-style face feature point detection method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] The technical solution adopted in the present invention is: detection of multiple style face feature points based on convolutional neural network, involving style aggregation face generation and face feature point detection, using the complementary advantages of the original face image and style aggregation face image , using a cascading strategy to generate predictions of face feature points, this method should meet two requirements:

[0043] 1. Generation of style-aggregated face images.

[0044] 2. Utilize the complementary advantages of the original face image and the style-aggregated face image to generate predictions of facial landmarks.

[0045] The content of the invention is described in detail below:

[0046] The generation of style-aggregated face images is divided into the following five steps:

[0047] The first step: select AFLW as the original image data set;

[0048] The second step: Preprocessing the original face image, converting the original image...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of face recognition, and particularly relates to a multi-style face feature point detection method based on a convolutional neural network. According to the invention, fine tuning training is carried out on a residual network (ResNet-152) by inputting multiple styles of face images, so that style discrimination features are obtained; style clustering isperformed on the original image by using K-means by using style discrimination features; a style-aggregated face image set is generated through a generative adversarial network; finally, the originalface image and the style aggregation face image are jointly used as input, and face feature point prediction is generated through a cascade strategy. According to the method, errors caused by multiple styles to face detection are reduced, the accuracy of face detection is improved, and the method can be applied to face recognition, head posture estimation, face reconstruction, 3D face reconstruction and the like.

Description

technical field [0001] The invention belongs to the technical field of face recognition, and in particular relates to a multi-style face feature point detection method based on a convolutional neural network. Background technique [0002] With the rapid development of science and technology and society, face recognition technology has been widely used. Such as finance, security construction, aerospace construction, student education and various entertainment and other fields. Recently, more and more people pay attention to the detection of facial landmarks, such as eye corners, eyebrows, and nose tips. It is also a prerequisite for computer vision applications. Facial landmark detection can be applied to a wide variety of tasks, for example, face recognition, head pose estimation, face reconstruction and 3D face reconstruction. At present, the latest progress in face landmark detection mainly focuses on learning discriminative features from rich deformations of facial sha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V40/172G06V40/161G06V40/168G06N3/045G06F18/23213G06F18/241
Inventor 张驰印桂生刘杰张万松张立国董宇欣左叶楠
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products