Stress aid decision making experimental device and method based on interaction of multiple sensing channels

Abstract

The invention provides a stress aid decision making experimental device and method based on interaction of multiple sensing channels. The stress aid decision making experimental method based on interaction of the multiple sensing channels comprises the steps that (1) a stress task in a stress running mode is started, an expression signal, a voice signal and a physiological signal of a person to be tested in the stress task are collected, and the collected expression signal, voice signal and physiological signal are fused to obtain a target signal; (2) a stress state type corresponding to the target signal in the stress running mode is obtained according to the target signal; (3) the multichannel reaction priority sequence of the stress state type is determined according to the stress state type, a corresponding stress aid decision making method in a knowledge and method base is used, and the stress decision making of the person to be tested in the stress running mode is assisted according to the stress aid decision making method. According to the stress aid decision making experimental method based on interaction of the multiple sensing channels, the knowledge and method base, a data base and a model base are used comprehensively to design an inference machine, then a stress aid decision making system is established, and man-machine interaction is achieved.

Description

Technical field [0001] The invention belongs to the technical field of ergonomics, and relates to a multi-sensing channel interactive stress assisted decision-making experiment device and an experiment method thereof. Background technique [0002] With the rapid development of information technology, the display and control system of new equipment in the future will inevitably put forward higher requirements for human-computer interaction. The display and control system is an important human-computer interaction interface for the transfer of information between the operator and the equipment. It is not only directly related to the speed and quality of the operator's response to information perception, but also directly affects the safety of decision-making. Especially in combat, pilots are in the stressful process of "information explosion". Therefore, the size, number, display symbols, pictures, warning information types, and display channels of the display screen will become im...

AI Technical Summary

Problems solved by technology

For example, Wang Qiang and others have developed an Agent-based multi-channel interactive system, but its practicability needs to be improved, and the users must be carefully trained to operate better; some scholars have conducted research on the HRV activation levels of the visual and auditory channels , HRV is an important reference index in the stress state of the human body, and it is found that the activation level of the visual channel on HRV is higher than that of the auditory channel on HRV

Images