Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Prior algorithm-based facial expression image occlusion restoration method

A technology of facial expression and facial image, which is applied in the field of facial expression restoration, can solve the problems of not being real enough, the recognition accuracy rate drops, and the expression does not match, etc., to achieve the effect of increasing accuracy and improving accuracy

Active Publication Date: 2020-09-15
DALIAN NATIONALITIES UNIVERSITY
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Usually these repair methods cannot achieve accurate repair. With the introduction of more and more neural networks, there are more and more methods for facial expression repair.
In the past, GAN network, PCA+SVM method, sparse representation method (Sparse representation based classification, SRC) and CNN method, all of them will lead to the accuracy of expression restoration is not ideal and not realistic enough in the partial occlusion problem. The expressions are not very real and coherent
This will also lead to poor results in the field of face recognition and a decrease in recognition accuracy.
[0005] For the implementation of the above method, only the facial expressions that cover the face are repaired, and no judgment algorithm after repair is added. Because only the discriminator in the network model is used to correct the accuracy of the image, there is no correction for the repaired image. Judging and identifying, which makes the restored expression not conform to the law of facial muscle movement to some extent, making the restoration effect not good
At the same time, there will be some errors with the original expression in the process of expression restoration, and eventually the expression of some expressions will not conform to the expression of the original expression image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Prior algorithm-based facial expression image occlusion restoration method
  • Prior algorithm-based facial expression image occlusion restoration method
  • Prior algorithm-based facial expression image occlusion restoration method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention is described below in conjunction with accompanying drawing and specific embodiment:

[0053] Such as figure 1 As shown, a facial expression image occlusion repair method based on a priori algorithm, including the following steps:

[0054] S1, original face image processing: collect unoccluded face images from the facial expression database as the original face image data set, and make the original face image data set include face images with different expressions; the original face data The concentrated face images are cropped so that each face image only retains the area of ​​the face, and a data set of unoccluded face areas is obtained;

[0055] The cropping process includes face alignment processing. Since a face contour shape contains feature points of the face, the contour shape as close as possible to the real face shape can be estimated through face alignment.

[0056] The specific method of face alignment processing adopted by the presen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a prior algorithm-based facial expression image occlusion restoration method, comprising the following steps: S1, processing an original facial image; S2, performing model training; S3, restoring the shielded facial expression image; S4, collecting facial motion units; S5, judging the expression of the restored image; and S6, performing simulation transformation on the secondary restored image. According to the prior algorithm-based facial expression image occlusion restoration method, after the neural network is restored, the facial expression image can be judged, andwhether the restoration effect is reasonable and accurate or not is judged; the accuracy of the repairing effect is greatly improved, and the prior algorithm-based facial expression image occlusion restoration method conforms to the law of facial muscle movement of the human face and is more real; and when a facial expression image is subjected to simulation transformation, transformation coordinate parameters can be modified by adjusting amplitude parameters, and coordinates of key feature points are also transformed along with the transformation coordinate parameters, namely, the mouth corner opening degree, so that the expression transformation amplitude can be obtained. The prior algorithm-based facial expression image occlusion restoration method improves the accuracy of operation.

Description

technical field [0001] The invention relates to the technical field of facial expression restoration, in particular to a priori algorithm-based occlusion restoration method for facial expression images. Background technique [0002] In recent years, with the rapid development of information technology and the wide application of computers, facial expression occlusion restoration and its recognition technology have been widely used in human-computer interaction, public safety monitoring, daily monitoring, psychological analysis, entertainment industry, etc. Face recognition technology faces a large number of rich application requirements, but also faces different challenges, such as lighting, occlusion, posture, environment and angle and other factors. Occlusion is very important among many factors affecting the performance of face recognition, and it is also an unavoidable factor. Therefore, an efficient and accurate method is needed to repair facial occlusion expression ima...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T5/50G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06T5/50G06N3/08G06T2207/10004G06T2207/20081G06T2207/20084G06T2207/30201G06V10/25G06N3/045G06F18/214G06T5/00
Inventor 丁阳王元刚
Owner DALIAN NATIONALITIES UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products