Student learning state analysis method and device based on multiple modes

Abstract

The invention provides a student learning state analysis method and device based on multiple modes, and the method comprises the steps: carrying out the processing of a collected first RGB image, a depth image, a second RGB image and an environment sound signal, carrying out the multi-modal analysis through combining the fondness degree, behavior actions and environment sound of a student, and finally obtaining the attention concentration degree of the student. The method can effectively evaluate the learning attention of the student, obtains the learning state of the student, is favorable for guiding teachers and parents to guide and correct the learning state of the student in a targeted manner, timely and effectively corrects the bad habits of the student in the learning process, and helps the student to better learn.

Description

technical field [0001] The invention relates to the technical field of student learning state analysis, in particular to a multimodal-based student learning state analysis method and device. Background technique [0002] According to observations, most primary and middle school students are easily distracted in class, like to do small movements, or talk casually, play for a while while doing homework, and are easily disturbed by the outside world. These are important manifestations of lack of attention, and lack of attention leads to a decline in learning efficiency and an important reason for poor learning effects. Moreover, as the pace of life is getting faster and faster, parents seldom spare time to tutor students in their studies. When there are problems in learning and learning, parents cannot quickly locate the students' problems, and they also have no way to help students correct the problems, which leads to family disharmony. And other issues. [0003] In addition...

AI Technical Summary

Problems solved by technology

[0006] The present invention solves the problem that the prior art does not evaluate the students' attention and cannot guide and correct the students' learning status in a targeted manner, and proposes a method and device for analyzing the students' learning status based on multimodality, which helps parents and teachers more convenient Quickly understand the learning status of students, and according to the current learning status of students, timely and effectively correct the bad habits of students in the learning process to help students learn better

Images