Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network

A convolutional neural network and multi-feature fusion technology, applied in neural learning methods, biological neural network models, neural architectures, etc., can solve problems such as training effects and gradient dispersion, and achieve poor solutions.

Active Publication Date: 2022-03-15
HUAZHONG NORMAL UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, the continuous deepening of the number of network layers will cause the problem of gradient dispersion, which will also have a certain impact on the training of the network.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network
  • Facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network
  • Facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The invention provides a facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network.

[0062] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0063] The specific implementation of this embodiment includes the following steps:

[0064] Step 1, perform face detection and data preprocessing on the training data set and the images that need to be recognized by expressions, and reduce background information interference. The specific implementation of step 1 includes the following sub-steps:

[0065] Step 1.1, construction of training data set. The present invention recruited 69 people as subjects, including 22 males and 47 females. By watching the induction video, the subjects' facial expressions were recorded. Then the recorded video was played, and the subjects and an experimenter gave their own expression labels. For t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a facial expression recognition method based on cross-connection multi-feature fusion convolutional neural network, comprising the following steps: first, performing face detection and data preprocessing to reduce background information interference; then, building a cross-connection multi-feature fusion The convolutional neural network automatically extracts rich and effective facial expression features, and fuses the high and low-level features of the network; finally, the softmax is used for facial expression classification. The present invention fuses high-level semantic features and low-level features of facial expression images, and makes full use of the feature information learned by each hidden layer to extract more adequate and detailed expression features, and solves the problem of poor expression recognition effect, The problem of poor robustness.

Description

technical field [0001] The invention belongs to the technical field of facial expression recognition based on deep learning, and in particular relates to a facial expression recognition method based on a cross-connection multi-feature fusion convolutional neural network. Background technique [0002] The general steps of facial expression recognition include face detection, image preprocessing, expression feature extraction and expression classification. The current algorithm research on face detection, image preprocessing and expression classification has been relatively mature, and the core link of expression feature extraction has become the current research focus. In the traditional facial expression recognition method, using hand-designed expression features, which relies on professional knowledge and luck, it is difficult to extract comprehensive information, and it is sensitive to lighting changes, etc., and is not robust enough in real scenes. As an algorithmic tool...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/16G06V10/80G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/161G06V40/168G06V40/172G06V40/174G06N3/045G06F18/241G06F18/253
Inventor 田元李方迪周晓蕾王志锋董石姚璜周幂
Owner HUAZHONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products