Face rigid body model and fixation point detection method and device and storage medium

A rigid body and model technology, applied in the field of face rigid body model and gaze point detection, can solve problems such as the decrease of gaze point calculation accuracy

Pending Publication Date: 2022-07-08
BOE TECH GRP CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Although the 9-point calibration method has high accuracy when the face remains still, when the face moves or rotates, the polynomial model obtained by the historical 9-point calibration is no longer applicable due to the change of the face pose. The line of sight calculation under the current face pose makes the calculation accuracy of the gaze point drop significantly

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face rigid body model and fixation point detection method and device and storage medium
  • Face rigid body model and fixation point detection method and device and storage medium
  • Face rigid body model and fixation point detection method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0262] In a possible implementation manner, the obtaining module 1101 is further used for:

[0263] displaying a first gaze area at a position closest to the photographing device in the display screen;

[0264] Continue to shoot the second visible light face image when the current user gazes at the first gaze area, until it is determined that the current user's face image is photographed in the forward direction;

[0265] Every time a shot is taken, a second intersection of the current user's face orientation and the display screen, and a second face pose are determined according to the second visible light face image; wherein, the second face pose is used to represent the posture angle of the current user's face;

[0266] Determine whether the second intersection point is within the first gaze area, and whether the second face pose is within a set error range;

[0267] If the second intersection point is within the first gaze area, and the second face pose is within the set...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face rigid body model, a fixation point detection method and device and a storage medium, and the method comprises the steps: obtaining a first visible light face image of a current user, which is forwardly shot by an image sensor, and obtaining a preset number of feature points of the face of the current user from the first visible light face image; determining a left eyeball center three-dimensional coordinate, a right eyeball center three-dimensional coordinate and a face center three-dimensional coordinate of the current user based on the preset number of feature points; and respectively establishing a left eye vector and a right eye vector from the left eyeball center three-dimensional coordinate and the right eyeball center three-dimensional coordinate to the face center three-dimensional coordinate, and mapping the left eye vector and the right eye vector to the face three-dimensional model to obtain a face rigid body model of the current user.

Description

technical field [0001] The present invention relates to the field of machine vision, in particular to a face rigid body model and a method, device and storage medium for gaze point detection. Background technique [0002] At present, the spatial gaze tracking system mostly adopts the method of polynomial model mapping. Generally, the 9-point calibration method is adopted, that is, the human eye looks at 9 calibration points on the screen (equivalent to a two-dimensional plane) in turn, so as to obtain the distance between the pupil and the screen. The coordinate mapping model of , which is used to calculate the coordinates of the gaze point on the screen. [0003] Although the 9-point calibration method has high accuracy when the face remains stationary, when the face moves or rotates, the polynomial model obtained from the historical 9-point calibration is no longer suitable for The gaze calculation under the current face pose makes the calculation accuracy of the gaze poi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06V40/19G06V40/18
Inventor 薛亚冲张浩陈丽莉孙建康闫桂新刘小磊吕耀宇张梦蕾李鑫恺
Owner BOE TECH GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products