Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A face attribute recognition method based on multi-instance and multi-label depth transfer learning

A technology of transfer learning and attribute recognition, which is applied in the field of face attribute recognition based on multi-instance multi-label deep transfer learning, which can solve the problems of time-consuming, low executable degree, and difficulty in determining the parameters to be adjusted, etc., to improve the speed , good effect

Active Publication Date: 2019-02-12
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Moreover, training is a very time-consuming process, and the parameters to be adjusted are not easy to determine in different situations, and the degree of execution in practical applications is not very high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A face attribute recognition method based on multi-instance and multi-label depth transfer learning
  • A face attribute recognition method based on multi-instance and multi-label depth transfer learning
  • A face attribute recognition method based on multi-instance and multi-label depth transfer learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0011] The present invention will be further explained below.

[0012] A face attribute recognition method based on multi-instance multi-label deep transfer learning, comprising the following steps:

[0013] Step 1: Prepare the face image data set, the face image contains the relevant face attribute labels corresponding to the face image; then extract the key point position coordinates of each face image, and use the key points for face alignment; The face image data set is randomly divided into FaceA and FaceB according to the ratio of 1:1. These two face data sets will be used in the next steps respectively.

[0014] The face image dataset selected in this example is CelebA, which has been face-aligned. There are more than 200,000 face images and 40 face attribute true values. In order to minimize the imbalance of face attribute data, this embodiment selects Arched Eyebrows, Attractive, Heavy Makeup, High Cheekbones, Male, Mouth Slightly Open, Oval Face, Pointy Nose, Smilin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a face attribute recognition method based on multi-instance multi-label depth migration learning, which comprises the following steps of preparing a face image data set, extracting a plurality of neural layer features of a depth convolution neural network migration model for each face image, and combining the neural layer features to form a multi-layer face feature; builinga network model for extracting multi-label relationship features, and training the parameters of the network model by using multi-layer face features as input and multi-face attribute tags as true values; designing a linear binary classifier for each face attribute, migrating the trained network model of multi-label relational features to the multi-face attribute classifier model as a feature extractor, and training each linear binary classifier by using face image data set. The method of the invention selects a transfer learning mode, rapidly and efficiently migrates a highly active transfermodel to a selected data set, builds a multi-tag relation characteristic model with simple training structure, and simultaneously trains a linear binary classifier of multiple human face attributes.

Description

technical field [0001] The invention belongs to a face attribute recognition method realized by applying deep learning in the field of computer vision. Background technique [0002] Face attribute recognition is an important subject, which can be applied to the research in the field of face recognition, such as face confirmation and face identification. The face and the surrounding area in the face image have many attributes, among which the attributes that are often considered are gender, hairstyle, expression, whether to wear glasses or a hat, and so on. It is more complex and difficult to study the face attribute recognition of face pictures in non-laboratory scenes, because many constraints are different, such as different face poses, occluders, different resolutions, and differences in brightness and color. But it is of great significance for the research of face attribute recognition in non-laboratory scenarios, because it is closer to the face pictures obtained in re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/168G06V40/172G06N3/048G06N3/045
Inventor 张立言葛宏孔
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products