Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Expression recognition method integrating global and local features of human face

A technology for local feature and expression recognition, applied in character and pattern recognition, acquisition/recognition of facial features, neural learning methods, etc., can solve problems such as gradient disappearance, overfitting, model degradation, etc., to improve accuracy and optimize network. Model, the effect of alleviating the overfitting problem

Pending Publication Date: 2021-04-13
ZHEJIANG UNIV OF TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the deficiencies of the prior art, the present invention provides an expression recognition method that integrates the global and local features of the human face. By dividing the human face into multiple parts, the global and local features of the human face are extracted to solve the problem of the prior art. Incomplete face feature extraction and over-fitting, gradient disappearance, and model degradation problems in deep network training further improve the accuracy of facial expression recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression recognition method integrating global and local features of human face
  • Expression recognition method integrating global and local features of human face
  • Expression recognition method integrating global and local features of human face

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be further described below in conjunction with the accompanying drawings.

[0035] refer to Figure 1 ~ Figure 4 , an expression recognition method that integrates the global and local features of the face. First, the original image is preprocessed, including grayscale normalization, size normalization, and pixel normalization. The preprocessed pictures are divided into training set and The test set, and then build the GL-FER network model, input the pre-training set pictures into the GL-FER network model, extract the global features and local features of the face; input the global and local features into the softmax classifier for training and Facial expression recognition obtains a recognition model that integrates global and local features of the face. The test shows that the accuracy of facial expression recognition can be effectively improved by fusing the global and local features of the face.

[0036] The main implementation process o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an expression recognition method integrating global and local features of a human face, and the method comprises the steps: designing three branches at a model feature extraction stage; enabling the first branch to use the whole face picture to extract the global features of the face; enabling the second branch to cut the face into two parts from top to bottom, enabling the third branch to cut the face into three parts from top to bottom, and extracting local features of the face; fusing the extracted global and local features, and inputting the fused features into a softmax classifier for face expression classification to obtain a recognition model integrating the global and local features of the face. Experiments show that the method of respectively extracting global and local features and then fusing the features can improve the accuracy of facial expression recognition.

Description

technical field [0001] The invention belongs to the fields of facial expression recognition, image processing and artificial intelligence, and in particular relates to an expression recognition method integrating global and local features of human faces. Background technique [0002] Facial Expression Recognition (FER) is an important means for machines to perceive human emotions and interact with humans, and it is an important research direction of human-computer interaction. Through the analysis of human facial expressions, it can roughly reflect the current emotions and potential intentions of people, which plays a decisive role in the social communication between people. At the same time, the advancement of facial expression recognition technology can promote the development of image processing, artificial intelligence and other fields. [0003] Traditional facial expression recognition usually first manually extracts facial features and then inputs them into a classifi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/169G06V40/171G06V40/174G06N3/045G06F18/2453G06F18/253G06F18/214
Inventor 张繁陆秀芹李小薪
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products