Method for detecting a facial micro-expression action unit based on a depth convolution neural network

An action unit and neural network technology, applied in the fields of face recognition and emotional computing, can solve the problems of difficult detection of action units and low detection accuracy of action units, achieve high accuracy, improve detection accuracy, and avoid omissions

Active Publication Date: 2019-02-15
BEIJING NORMAL UNIVERSITY
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the detection accuracy of action units using traditional geometric shape feature methods is very low, and action units are often affected by typical geometric structures such as the face, mouth, nose, eyebrows, etc., which are difficult to detect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for detecting a facial micro-expression action unit based on a depth convolution neural network
  • Method for detecting a facial micro-expression action unit based on a depth convolution neural network
  • Method for detecting a facial micro-expression action unit based on a depth convolution neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] A method for detecting human face micro-expression action units based on deep convolutional neural network, including the following steps:

[0038] Step 1: Design a deep convolutional neural network structure, take the face sample data set as input, and automatically labeled micro-expression action units as output, train the network structure, and learn appropriate network parameters;

[0039] Step 1.1: For the images in the sample data set, mark the face and the rectangular shape areas of different action units;

[0040] Step 1.2: Design and implement a deep convolutional neural network. The neural network includes a convolutional layer, a shortcut layer, and an action unit detection layer to learn the information of the face and its different expression action unit regions, and obtain the network forward propagation Parameters, each convolutional layer uses a set of convolution parameter templates to perform convolution operations on the feature images of the previous layer,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for detecting a facial micro-expression action unit based on a depth convolution neural network, which comprises the following steps: step 1, designing a depth convolution neural network structure; 1.1, marking that face and the rectangular shape area of different action units therein; 1.2, designing and realizing a depth convolution neural network, wherein that neural network comprise a convolution layer, a shortcut layer and an action unit detection layer, so as to learn the information of the face and the action unit area of different expression of the faceand the face, and obtain forward propagation parameters of the network; Step 1.3: taking the sample data in the face sample data set as the input data of the neural network; 2, detecting a facial expression action unit according to the network parameters learned in the step 1; Step 3: Visualize the output according to the face action unit detected in step 2. The detection method of the invention relies on a deep-layer convolution neural network to detect and recognize an action unit in a face image, and the detection accuracy and the detection speed can be improved.

Description

Technical field [0001] The present invention relates to the technical field of face recognition and emotion computing, in particular to a method for detecting human face micro-expression action units based on a deep convolutional neural network. Background technique [0002] Human face micro-expression is a natural expression of human inner emotions. Compared with ordinary expressions, micro-expression is not easy to be detected. It has the characteristics of small movement range and short stay time. The corners of the mouth are raised to express inner joy; The inadvertent curling up may hide the inner contempt; the upper lip is pushed up by the lower lip, which may hide a little dissatisfaction; the inner corner of the eye and the depression of the eyebrows may hide anger. These are the natural emotions of the micro expression Expression, because micro expressions are the leakage of real emotions, the detection and recognition of micro expressions is of great significance for cr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/176G06V40/168G06V40/172
Inventor 樊亚春税午阳邓擎琼
Owner BEIJING NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products