Online learning attention tracking method based on sight line estimation and application thereof

Abstract

The invention discloses an online learning attention tracking method based on line-of-sight estimation and application thereof. The method comprises the steps that a face image, an eye image and a binocular infrared image of a to-be-detected object and a scene image of a learning environment where the to-be-detected object is located are acquired; the scene image comprises an image of learning equipment interacting with the to-be-detected object; inputting the face image, the eye image and the two-eye infrared image into a sight line estimation recognition model to obtain the three-dimensional gazing direction of the two eyes of the to-be-detected object in a camera coordinate system; converting the three-dimensional fixation direction under the camera coordinate system into a two-dimensional fixation point under a screen coordinate system where the learning device is located; generating a current attention detection result of the to-be-detected object according to a position relationship between the two-dimensional fixation point and a learning area in the scene image; according to the invention, complementation of the head posture and the two eye features is realized, the accuracy of sight line estimation under a complex background is improved, and objective support data is provided for improving the line learning attention of students.

Description

technical field [0001] The present application relates to the technical field of intelligent human-computer interaction, and more specifically, relates to an attention tracking method for online learning based on gaze estimation, computer equipment and readable media. Background technique [0002] With the rapid development of education informatization, artificial intelligence technology has been increasingly used in the process of education and teaching. In recent years, the outbreak of novel coronavirus pneumonia has broken the traditional offline teaching mode, and online distance teaching methods have been widely adopted for a while. However, in the absence of close supervision from teachers, how to achieve remote supervision or self-supervision to ensure the learning status and learning efficiency of learners' independent learning has become an urgent problem to be solved. Therefore, adopting an online learning attention tracking method to assist learners in online lea...

AI Technical Summary

Problems solved by technology

[0005] At present, although the research on gaze estimation technology has made great progress, the accuracy of gaze estimation based on general models and single eye features is limited. In addition, the movement range of the user's head will have a great impact on the measurement results, reducing the Recognition accuracy, which in turn limits the accuracy of online learning attention tracking detection

Images