Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Real-time classroom student state analysis and indication reminding system and method based on behavior and voice intelligent recognition

A technology of intelligent recognition and state analysis, applied in the application field of artificial intelligence and new teaching technology, can solve problems such as inattentiveness in listening to lectures

Active Publication Date: 2020-04-10
SHANDONG UNIV
View PDF5 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the common problems in current school students' classroom learning such as not being serious about listening to lectures, the present invention provides a real-time classroom student status analysis and instruction reminder system based on behavior and voice intelligent recognition;

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time classroom student state analysis and indication reminding system and method based on behavior and voice intelligent recognition
  • Real-time classroom student state analysis and indication reminding system and method based on behavior and voice intelligent recognition
  • Real-time classroom student state analysis and indication reminding system and method based on behavior and voice intelligent recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0127] A real-time classroom student status analysis and instruction reminder system based on behavior and voice intelligent recognition, such as figure 1 As shown, it includes multimodal information perception and collection module, multimodal data intelligent identification module, classroom context knowledge base module, multimodal data analysis module, student classroom status report output module, student classroom status judgment module, and student classroom status Instruction module and student classroom status adjustment module;

[0128] Multimodal information perception and collection module, multimodal data intelligent identification module, classroom context knowledge base module, multimodal data analysis module, and student classroom status report output module are connected sequentially; multimodal data intelligent identification module, student classroom status The judging module, the student classroom status indication module and the student classroom status ad...

Embodiment 2

[0138] According to a kind of real-time classroom student status analysis and instruction reminding system based on behavior and voice intelligent recognition described in embodiment 1, its difference is:

[0139] The multimodal information perception and acquisition module includes an image perception acquisition unit and a voice perception acquisition unit, and the image perception acquisition unit and the voice perception acquisition unit sense and collect raw data synchronously.

[0140] The image sensing acquisition unit uses the classroom camera monitoring system to sense and collect the original images of students; the voice sensing acquisition unit uses the recording equipment to sense and collect the voice data of classroom teaching.

[0141] The multimodal data intelligent recognition module includes a student real-time positioning unit, a student real-time behavior classification and recognition unit, and a teacher-student real-time voice interaction classification a...

Embodiment 3

[0162] According to a kind of real-time classroom student status analysis and instruction reminding system based on behavior and speech intelligent recognition described in embodiment 2, its difference is:

[0163] The multimodal data analysis module includes a student behavior analysis unit and a teacher-student voice interaction analysis unit.

[0164] The student behavior analysis unit is used to analyze the behavior of students in the classroom. By counting the various learning behaviors and non-learning behaviors of each student in the classroom teaching process and their duration, it is used to analyze the different time of different behaviors in the classroom learning process. The ratio shows the overall learning situation of each student and all students in the classroom from the perspective of behavior, including three indicators: the individual effective learning behavior index of students, the average effective learning behavior index of classroom students, and the i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a real-time classroom student state analysis and indication reminding system and method based on behavior and voice intelligent recognition. A multi-modal data intelligent recognition module carries out classification and recognition on original images and voice data of students; a classroom context knowledge base module provides a judgment basis and specific algorithm guidance of analysis; a student classroom state judgment module judges the classroom state of the student; the student classroom state adjusting module is used for teachers or students to adjust according to the display of student states; a multi-modal data analysis module analyzes the classroom behavior performance of the students and the voice interaction performance of the teachers and the students; and a classroom state report output module outputs a classroom state report. According to the invention, the problems of inattention of students in class, poor classroom learning effect and the like in the current college and university classrooms are solved, and the system and the method have great reference value for the improvement of classroom teaching of the teachers.

Description

technical field [0001] The invention relates to a real-time classroom student state analysis and instruction reminder system and method based on behavior and voice intelligent recognition, belonging to the technical field of artificial intelligence and teaching new technology application. Background technique [0002] At present, the existing student classroom learning quality evaluation system mostly evaluates students' learning quality by statistically analyzing certain parameters of students in class, but this evaluation method is basically based on a single behavior or expression of students, and does not comprehensively consider the classroom environment. A variety of other factors, also can not carry out real-time feedback and adjustment, the evaluation of classroom teaching is not comprehensive enough. [0003] How to use information technology to realize real-time instruction and analysis of students' classroom status has become an urgent need to improve the quality ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G10L15/26
CPCG10L15/26G06V40/172G06V40/168G06V10/507G06V10/462G06F18/24
Inventor 许宏吉赵文杰李梦荷樊士迪冯金库李恬阔王珏
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products