Identification method of user operation intention and cognitive state in human-computer interaction

A technology of human-computer interaction and identification method, applied in the field of ergonomics, can solve the problems of operators' physical and psychological burden, increased operation error rate, stress, etc., and achieve the effect of improving the efficiency and reliability of human-computer interaction

Pending Publication Date: 2020-06-02
AIR FORCE UNIV PLA
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In many fields such as aviation flight operation, weapon equipment operation, CNC machine tool operation, manufacturing operation system monitoring and operation, operators need to complete a large number of interactive tasks, process massive amounts of information, and have high requirements for timeliness and accuracy. This has caused a great burden on the operator's physiology and psychology.
In addition, long-term high-intensity operations have continuously reduced the work efficiency of operators, and the rate of operational errors has continued to increase.
However, the existing system has a low level of intelligence and cannot perceive the operational needs of operators, which reduces the efficiency and reliability of interactive tasks.
[0003] In addition, the operator may be in a different cognitive state during the process of completing the human-computer interaction task: in the on-duty task, since the operator only needs to roughly monitor the entire interface, it is very easy to be "out of the loop" due to the monotony of the task
Once an alarm occurs, the operator needs to deal with the abnormal situation quickly, and it is very easy to cause "stress" due to the tension of the task
If it is impossible to monitor the cognitive state of the operator in real time, give a warning when "out of the loop", and provide information assistance when "stressed", it will be difficult to guarantee the reliability and efficiency of the human-computer interaction process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Identification method of user operation intention and cognitive state in human-computer interaction
  • Identification method of user operation intention and cognitive state in human-computer interaction
  • Identification method of user operation intention and cognitive state in human-computer interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The embodiments and effects of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0029] refer to figure 1 and figure 2 , an embodiment of the present invention provides a method for identifying a user's operation intention and cognitive state in human-computer interaction, including the following steps:

[0030] Step 1, collect the user's eye movement feature data and EEG signal data during the human-computer interaction process;

[0031] Specifically, a single-camera dual-infrared sensor eye-tracking device is used to collect eye movement feature data: the X and Y coordinates of the effective fixation point of the user's eyes, fixation time, saccade amplitude, and pupil diameter; electrical signal data.

[0032] Step 2, normalize the eye movement characteristic data to obtain standardized eye movement characteristic data, select the standardized eye movement characteristic data of a plurality of continu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses an identification method of user operation intention and cognitive state in human-computer interaction. The method comprises the following steps: collecting eye movement characteristic data and electroencephalogram signal data of users in a human-computer interaction process; pre-processing the collected data and respectively dividing into a training set and a testset; and using the training set to train an SVM classifier and then using the optimized classifier to classify the test set to obtain corresponding operation intention and cognitive state. The identification method can identify operation requirements in the interaction process, provides a basis for adaptive adjustment of interfaces, at the same time, can judge the cognitive state of the interaction process and ensures reliability of completion of interaction tasks.

Description

technical field [0001] The invention belongs to the technical field of ergonomics, and in particular relates to a method for identifying user operation intentions and cognitive states in human-computer interaction. Background technique [0002] In many fields such as aviation flight operation, weapon equipment operation, CNC machine tool operation, manufacturing operation system monitoring and operation, operators need to complete a large number of interactive tasks, process massive amounts of information, and have high requirements for timeliness and accuracy. This has caused great burden to the operator's physiology and psychology. In addition, long-term high-intensity operations have continuously reduced the work efficiency of operators, and the rate of operational errors has continued to increase. However, the existing system has a low level of intelligence and cannot perceive the operational needs of operators, which reduces the efficiency and reliability of interactiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61B5/0476A61B5/16A61B5/00
CPCA61B5/4076A61B5/7267A61B5/746A61B5/163A61B5/369
Inventor 王崴胡波瞿珏刘海平高鹏蔡睿陈龙赵敏睿
Owner AIR FORCE UNIV PLA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products