Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face attention judgment method, device and equipment and storage medium

An attention and face technology, applied in the field of image processing, can solve problems such as low efficiency and complex implementation process

Inactive Publication Date: 2020-02-25
北京如布科技有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a method, device, equipment, and storage medium for judging human face attention, so as to solve the problems of complex implementation process and low efficiency in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face attention judgment method, device and equipment and storage medium
  • Face attention judgment method, device and equipment and storage medium
  • Face attention judgment method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] figure 1 This is a schematic flow diagram of a method for judging face attention provided by the first embodiment of the present invention. This embodiment can be applied to the situation where the result of face concentration is determined by face orientation information. The method can be judged by face attention The device can be implemented by means of software and / or hardware, and can be integrated on a computer device. Such as figure 1 As shown, the face attention judgment method specifically includes the following steps:

[0042] S110. Obtain a face image.

[0043] Among them, the face image is only collected by an ordinary monocular camera, without other additional hardware equipment.

[0044] S120: Use a pre-trained multi-task convolutional neural network to process the face image, and determine the position of the face frame, the face orientation, and the face pose.

[0045] Among them, the multi-task convolutional neural network includes: the front backbone network ...

Embodiment 2

[0052] figure 2 This is a schematic flow chart of a method for judging face attention provided in the second embodiment of the present invention. This embodiment is further optimized based on the above-mentioned embodiment, and the method can be executed by the device for judging face attention. Such as figure 2 As shown, it specifically includes the following steps:

[0053] S210. Obtain a face image.

[0054] S220: Use a pre-trained multi-task convolutional neural network to process the face image, determine the position of the face frame, the face orientation and the face pose, and obtain face orientation information.

[0055] S230: Perform a weighted summation to determine the single-frame face attention value according to the coordinates of the face frame position of each frame of the face image, the direction the face is facing, and the direction angle of the face posture, and the attention value of the single-frame face is determined according to the single-frame face attent...

Embodiment 3

[0070] image 3 It is a structural block diagram of the face attention judgment device provided in the third embodiment of the present invention, which can execute the face attention judgment method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method, such as image 3 As shown, the device includes:

[0071] The image acquisition module 301 is used to acquire a face image.

[0072] The image processing module 302 is configured to process the face image by using a pre-trained multi-task convolutional neural network to determine the position of the face frame, the face orientation and the face pose.

[0073] The face direction and angle determination module 303 is used to determine the coarse-strength face direction and the fine-strength face pose heading angle according to the face orientation and the face posture.

[0074] The attention determination module 304 is used to determine the result of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a face attention judgment method and device, equipment and a storage medium. The method comprises the following steps: acquiring a face image; processing theface image by using a pre-trained multi-task convolutional neural network, and determining a face frame position, a face orientation and a face posture; determining a coarse face orientation directionand a fine face orientation angle according to the face orientation and the face attitude; and determining a human face attention result according to the human face frame position, the human face orientation and the human face posture. According to the embodiment of the invention, the process of determining the human face orientation and the attention result is combined, and the human face attention concentration result is obtained by determining the human face orientation information, so that the attention judgment efficiency is improved, the judgment time is saved, and the algorithm complexity is reduced.

Description

Technical field [0001] The embodiments of the present invention relate to image processing technology, and in particular to a method, device, device, and storage medium for judging facial attention. Background technique [0002] Facial attention judgment is applied in many aspects. It can understand the seriousness of students in online classrooms, monitor the driving status of drivers, and play a huge role in remote technology, safety inspection, and information security. [0003] Current face orientation recognition methods usually use binocular cameras or depth cameras to collect images, and obtain depth image information containing the face area after detecting the face area to determine the specific face orientation. Facial attention judgment methods usually rely on the way of counting the direction of the human eye’s line of sight, using sensor equipment to collect images, detect the face area, extract the human eye area, use deep learning and other technologies to realize th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00
CPCG06V40/161G06V40/18
Inventor 汤炜
Owner 北京如布科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com