Apparent sight line estimation method based on human body posture analysis

A line of sight estimation and human body posture technology, applied in the field of apparent line of sight estimation based on human body posture analysis, can solve the problems of complex equipment and not widely used, and achieve the effect of improving accuracy and robustness

Pending Publication Date: 2020-02-14
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Model-based methods are not widely used because they require co

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Apparent sight line estimation method based on human body posture analysis
  • Apparent sight line estimation method based on human body posture analysis
  • Apparent sight line estimation method based on human body posture analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The invention proposes a method for estimating apparent line of sight based on human body posture analysis. Specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0023] The present invention mainly studies the line of sight estimation system based on human body posture. Head pose and object detection are mainly used for line of sight estimation when the face is facing and facing the camera sideways. When the face is facing away from the camera, human body posture is added to estimate the line of sight.

[0024] The present invention studies an algorithm combining target detection and head pose estimation, and uses the head pose to estimate line of sight when a human face faces a camera. The present invention studies how to use the target center position to correct the line of sight direction. The present invention needs to study the problem that the target that is too small may not intersect w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for estimating a sight line by combining human body posture information. A deep convolutional neural network comprising a salient target detection branch, a head posture estimation branch and a human body posture estimation branch is designed to estimate a sight line direction. And finally, prediction of a fixation point position is given through point multiplication according to the feature maps of the three branches, wherein a connecting line of the fixation point position and a head center position is used as thesight line direction. Through the method forestimating a sight line by combining human body posture information, the accuracy and robustness of the sight line estimation algorithm can be improved.

Description

technical field [0001] The invention belongs to the technical field of apparent line of sight estimation, in particular to an apparent line of sight estimation method based on human body posture analysis. Background technique [0002] Line of sight refers to the gaze direction of people's eyes, which usually represents the focus of people's attention. Line-of-sight information can assist machines in understanding human behavior, intentions, and the environment in which characters are located. Gaze estimation has great application value in human-computer interaction, attention analysis and video surveillance. [0003] As a tool for attention analysis, gaze estimation has the characteristics of quantification and visualization. For example, in reading research, through sight estimation, you can record where you pause, where you skip, where you look back, etc. When designing the pages of websites, magazines, and posters, using line-of-sight estimation technology, it is possi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06V10/25G06N3/045G06F18/241
Inventor 王轩漆舒汉尹李明蒋琳廖清刘洋夏文李化乐易正中李逸凡
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products