Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-mode information fusion-based classroom learning state monitoring method and system

A learning state, multi-modal technology, applied in the field of education informatization, can solve problems such as lack of solutions, and achieve the effect of improving credibility, improving teaching process analysis, and improving identifiability

Inactive Publication Date: 2018-11-13
HUAZHONG NORMAL UNIV
View PDF9 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, after the informationized and intelligent teaching environment is basically established, how to maximize its application value so that it can serve teachers' teaching and students' learning to the greatest extent, and better help teachers grasp students' classroom learning status is still an issue. Still missing a good solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode information fusion-based classroom learning state monitoring method and system
  • Multi-mode information fusion-based classroom learning state monitoring method and system
  • Multi-mode information fusion-based classroom learning state monitoring method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0027] like figure 2 As shown, the present invention is based on the classroom learning status monitoring method on the basis of multimodal information fusion, comprising the following steps:

[0028] (1) Collect the scene image in the classroom, and locate the face in the scene image;

[0029] (2) Estimate the face orientation pose in the face area, and evaluate the student's attention accor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-mode information fusion-based classroom learning state monitoring method and system. The method specifically comprises the following steps of: acquiring an indoor sceneimage and positioning faces in the scene image; estimating face orientation postures in a face region so as to estimate attentions of students according to the face orientation postures; estimating facial expressions in the face region; acquiring skin conduction signals of the students so as to estimating physiological activation degrees of the students according to the skin conduction signals; recording interactive answer frequencies and correctness of the students on the classroom so as to estimate participation degrees of the students; and fusing four-dimensional information such as attention, learning moods, the physiological activation degrees and the classroom participation degrees of the students so as to analyze classroom learning states of the students. The invention furthermoreprovides a system for realizing the method. By applying the method and system, the learning states of students on classrooms can be objectively and correctly monitored and analyzed in real time, so that the teaching process analysis is perfected and the teaching effect differentiation degree is enhanced.

Description

technical field [0001] The invention belongs to the technical field of education informatization, and in particular relates to a classroom learning state monitoring method and system based on multimodal information fusion. Background technique [0002] With the rapid development of information technology, the application of educational informatization has also been continuously enriched and deepened. The school's information-based teaching environment has been preliminarily established. Information technology represented by multimedia and the Internet has been widely used, and new elements have been introduced into the presentation of teaching content and teaching activities. However, classroom teaching is mostly limited to the traditional teaching mode of "transfer-acceptance". The evaluation of teaching effect is mostly concentrated on the students' final exam scores, and the observation and analysis of teaching behavior mostly stays in the traditional questionnaire survey...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06Q50/20
CPCG06Q50/205G06V40/175G06V40/172G06V40/166
Inventor 陈靓影彭世新徐如意刘乐元张坤
Owner HUAZHONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products