Attention judgment method, attention judgment device, attention judgment system, attention judgment equipment and storage medium

A technology of attention and pupils, which is applied in the field of information-based teaching, can solve the problems of inaccurate attention state and the inability to truly reflect the state of students' attention, and achieve good detection results, strong real-time performance, and strong reliability

Active Publication Date: 2019-06-18
上海像我信息科技有限公司
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, in the prior art, it is not accurate enough to detect the student's attention state only by the state of the person's face and head features, and cannot truly reflect the student's attention state

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Attention judgment method, attention judgment device, attention judgment system, attention judgment equipment and storage medium
  • Attention judgment method, attention judgment device, attention judgment system, attention judgment equipment and storage medium
  • Attention judgment method, attention judgment device, attention judgment system, attention judgment equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Such as figure 2 As shown, in one embodiment, a kind of attention judgment method is proposed, and this embodiment is mainly applied to the above-mentioned figure 1 The computer device 120 in the computer is used as an example, which may specifically include the following steps:

[0040] Step S201, acquire the video image of the target person, identify the face image of a single frame image in the video image, determine the first pupil sight vector in the face image, and the coordinate system where the first pupil sight vector is located is the camera coordinate system;

[0041] Step S202, converting the first pupil line of sight vector into a second pupil line of sight vector in the world coordinate system, and calculating the coordinates of the intersection point between the second pupil line of sight vector and the preset plane;

[0042] Step S203, judging the positional relationship between the coordinates of the intersection point and the preset area in the prese...

Embodiment 2

[0068] Such as Image 6 As shown, in one embodiment, a kind of attention judging device is provided, and this attention judging device can be integrated in the above-mentioned computer equipment 120, specifically can comprise:

[0069] The image processing module 601 is used to obtain the video image of the target person, identify the face image of a single frame image in the video image, and determine the first pupil line of sight vector in the face image, where the coordinate system of the first pupil line of sight vector is the camera coordinate system ;

[0070] Intersection coordinate calculation module 602, for converting the first pupil line of sight vector into the second pupil line of sight vector in the world coordinate system, and calculating the intersection coordinates of the second pupil line of sight vector and the preset plane;

[0071] The intersection point coordinate position judging module 603 is used to judge the positional relationship between the inters...

Embodiment 3

[0096] Such as Figure 9 As shown, in one embodiment, a kind of attention judgment system is provided, a kind of attention judgment system that the embodiment of the present invention provides, comprises:

[0097] An image acquisition device 901, configured to acquire a video image of a target person;

[0098] The attention judging means 902 is configured to acquire a video image of the target person, and execute the attention judging method in the embodiment of the present invention, so as to determine the attention state of the target person.

[0099] Such as Figure 10 As shown in FIG. 1 , the whole process of the work of the attention judgment system in the embodiment of the present invention is shown. In the embodiment of the present invention, after the scene image is captured by the image acquisition device 901, the person's attention determination device 902 recognizes the scene image and determines the attention state of the target person according to the recognitio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of information teaching, and discloses an attention judgment method, device and system, equipment and a storage medium. The method comprises the steps of obtaining avideo image of a target person, identifying a face image of a single frame image in the video image, and determining a first pupil sight line vector; Converting the first pupil sight vector into a second pupil sight vector under a world coordinate system, and calculating an intersection coordinate between the second pupil sight vector and a preset plane; Judging the position relation between theintersection coordinates and a preset area, and confirming whether the target sight line is deviated or not; And after all frames of images contained in the video image within the preset time are identified, determining the total number of times of sight line deviation, comparing the total number of times of sight line deviation with the preset number of times of deviation, and determining the attention state of the target person. According to the attention judgment method provided by the embodiment of the invention, the sight line direction vector is projected to the preset plane, the attention state of the target person is judged, and the method has the advantages of high real-time performance, high accuracy, high reliability and small influence of external factors.

Description

technical field [0001] The invention relates to the field of information-based teaching, in particular to a method, device, system, equipment and storage medium for judging attention. Background technique [0002] Online education is becoming more and more popular with the development of the network, and it is of great significance to determine the learning status of students in this mode. Attention detection is an important part of judging students' learning in online education. It can judge whether the attention is concentrated by using the characteristic changes of the face and facial features, or using brain wave detection or ECG frequency. [0003] At present, the application of most attention detection methods is to distinguish students' attention by identifying facial features and head features. However, when students are learning online in front of the computer screen, the capture of facial features and head features does not necessarily represent the current state ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
Inventor 夏立
Owner 上海像我信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products