Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face key point detection method, device and equipment and storage medium

A face key point and detection method technology, applied in the field of image recognition, can solve the problems of neural network model size limitation, increase the detection time of image frames, and not easy to obtain, so as to achieve both real-time and accuracy, and avoid detection time the increasing effect of

Inactive Publication Date: 2019-07-02
GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the neural network model is mostly used to realize face key point detection. In order to ensure the accuracy of the detection results, a large-scale neural network model is often used. The size of the neural network model will be limited, which will cause the execution terminal to perform face keying on images containing faces with large angles and large postures (head up at 45 degrees, head down at 45 degrees, head tilted to 90 degrees, etc.) Point detection does not perform well
[0004] In order to improve the key point detection effect of faces with large angles and large poses, the usual method is to add more face training samples with large angles and large poses to train the current neural network model, but in actual operation , such face training samples with large angles and large poses are not easy to obtain, and under the premise of limiting the network scale, the increase in sample complexity will often lead to a decrease in the accuracy of the neural network model in detecting normal face images. In addition, , if the network scale is increased to ensure the detection accuracy, the detection time of the image frame will be increased, and the real-time requirements of the detection cannot be guaranteed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face key point detection method, device and equipment and storage medium
  • Face key point detection method, device and equipment and storage medium
  • Face key point detection method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] Figure 1a A schematic flow chart of a face key point detection method provided in Embodiment 1 of the present invention is given. This method is applicable to the case of performing face key point detection on a face image, and the method can be executed by a face key point detection device. , wherein, the device can be implemented by software and / or hardware, and generally integrated on computer equipment, and specifically can be integrated as a plug-in in application software with human-computer interaction.

[0055] It should be noted that the execution subject of the facial key point detection method provided in this embodiment may be a computer device serving as a requesting terminal in data information interaction, and the computer device may include: a mobile terminal, a tablet computer, a desktop computer, and the like. In addition, this embodiment can specifically perform face key point detection on a video frame containing a person image.

[0056] Such as Fi...

Embodiment 2

[0078] Figure 2a A schematic flow chart of a human face key point detection method provided in Embodiment 2 of the present invention is given. This embodiment is optimized on the basis of the above embodiments. In this embodiment, the person of the current frame to be tested will be acquired The posture correction information of the human face in the original face image is further optimized as: obtaining the human face posture information of the original human face image in the previous frame of the current frame to be measured, as the information in the original face image of the current frame to be detected Face pose correction information.

[0079] At the same time, in this embodiment, the face pose in the original face image will be corrected according to the pose correction information to obtain a corrected face image. The specific optimization is as follows: the original face image and the pose correction information As input data, the image alignment model is input to...

Embodiment 3

[0124] image 3 A structural block diagram of a face key point detection device provided in Embodiment 3 of the present invention is given. The device is suitable for detecting face key points on face images. The device can be implemented by software and / or hardware , and generally integrated on computer equipment, such as image 3 As shown, the device includes: an information acquisition module 31 , an image correction module 32 , a key point determination module 33 and a key point correction module 34 .

[0125] Wherein, the information acquisition module 31 is used to obtain the original face image of the current frame to be tested, and obtain the posture correction information of the face in the original face image of the current frame to be tested;

[0126] An image correction module 32, configured to correct the face pose in the original face image according to the pose correction information, to obtain a corrected face image;

[0127] The key point determination modul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a face key point detection method, device and equipment and a storage medium. The method comprises the steps of obtaining a face original image of a current to-be-detected frame, and obtaining posture correction information of a face in the face original image of the current to-be-detected frame; correcting the face posture in the original face image according to the posture correction information to obtain a face correction image; carrying out face key point detection on the face correction image by adopting a key point detection network model to obtain correction key points; and performing reverse posture correction on the correction key points according to the posture correction information to obtain target face key points of the original face image. By utilizing the method, compared with the existing detection method, the detection precision of key point detection on the special face image can be ensured under the condition that the scale of the key point detection network model is not increased, and meanwhile, the increase of the detection time of the key point detection is avoided, so that the detection effect of real-time performanceand accuracy is achieved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image recognition, and in particular, to a face key point detection method, device, equipment, and storage medium. Background technique [0002] In the field of computer vision, face key point detection has been widely concerned by academia and industry. Its main function is to accurately locate the key points on the face (such as eyes, nose, mouth corners, face contour points, etc.), To prepare for subsequent face image processing (such as face alignment and face recognition), face key point detection has played an important role in application scenarios such as biometric information verification, surveillance security, and live video. [0003] At present, the neural network model is mostly used to realize face key point detection. In order to ensure the accuracy of the detection results, a large-scale neural network model is often used. The size of the neural network model will be...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06T3/60
CPCG06T3/608G06V40/161G06V40/168
Inventor 项伟黄秋实
Owner GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products