Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mouth opening/closing state detection method based on deep learning

A deep learning and state detection technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve the problems of insufficiency of living detection methods, and achieve the effect of avoiding unreasonable feature design and strong robustness

Inactive Publication Date: 2016-12-21
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to ensure the accuracy of detection, the face recognition system needs to have strong robustness to various disturbances in real life scenes. The robustness of scenes with illumination changes, pose changes, partial occlusions, and random noise still needs to be further improved to meet practical applications.
[0004] Since the traditional living body detection method cannot meet the demand for high-precision real-time living body detection in practical applications, the present invention proposes a high-precision mouth opening and closing state detection method that can be applied to interactive living body detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mouth opening/closing state detection method based on deep learning
  • Mouth opening/closing state detection method based on deep learning
  • Mouth opening/closing state detection method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail in conjunction with specific embodiments and with reference to the accompanying drawings.

[0035] The present invention provides a technical solution: a high-precision method for detecting the open and closed state of the mouth. In the live detection system currently in practical application, how to improve the detection accuracy in the scene full of noise and malicious attacks is an urgent problem to be solved . In view of this problem, the present invention uses a convolutional neural network layer to extract features, and at the same time uses a fully connected layer and a softmax function to perform feature classification, and uses neural network back propagation and stochastic gradient descent methods to adjust network parameters so that The extracted features are more robust and more adaptable to noise...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mouth opening / closing state detection method based on deep learning. The method mainly comprises a data preprocessing portion, a feature extraction portion, a feature classification portion and an error calculation portion. The method is mainly characterized by, through full utilization of the capability in extracting high-level features of a depth convolution nerve network, extracting robust features capable of coping with irregular noise, larger illumination change and the cases of hostile attack and the like by sheltering the mouth key part, which occur frequently in the practical application scene; carrying out classification on the extracted features by utilizing a full connection layer; and adjusting parameters through error calculation and through a stochastic gradient descent method to reduce errors, and allowing the detection method to be able to have a capability of identifying mouth opening / closing state automatically. Besides, the method can ensure both the required computing resources and storage space do not generate great fluctuation due to change of resolution of an image to be detected. The method is convenient to operate, simple and easy to use, higher in precision and safer and more reliable.

Description

Technical field [0001] The present invention belongs to the technical fields of image processing, pattern recognition, software engineering, etc., and in particular relates to a method for detecting the open and closed state of the mouth based on deep learning, and has the advantages of common in reality scenes where there is interference of light changes and partial occlusion of key parts of the face Very adaptable. Background technique [0002] The face is the most important appearance feature of a person, and face recognition technology has a wide range of applications in current popular application fields such as identity authentication and security protection, and has a very broad prospect. However, human faces are easily copied using photos, videos, etc., so the impersonation of the faces of legitimate users is an important threat to the security of the face recognition and authentication system. Therefore, an indispensable part of the existing face recognition system is t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/08
CPCG06N3/084G06V40/171G06V40/172
Inventor 孙哲南赫然李海青曹杰
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products