Attention guidance virtual reality system based on multi-sensory information fusion

Abstract

The invention discloses an attention guidance virtual reality system based on multi-sensory information fusion. The attention guidance virtual reality system comprises an electroencephalogram signal acquisition device, an electroencephalogram signal processor, an eye movement signal acquisition device, an eye movement signal processor, an execution device, a force sense feedback device, a system processor and a virtual reality audiovisual device. The electroencephalogram signal processor calculates event-related potential characteristics reflecting the selective attention state of the brain of the subject and event-related potential characteristics reflecting the continuous attention state of the brain of the subject according to the electroencephalogram signals. The eye movement signal processor calculates feature data of a fixation point range, fixation times, pupil diameter and eye jump distance of a subject according to the eye movement signals. And the system processor generates a multi-sensory information fusion guiding task, controls the dynamic process of the guiding task according to the electroencephalogram signal features and the eye movement signal features, and guides the attention of the subject. According to the invention, attention guidance can be carried out according to the state of the subject, the attention guidance effect is improved, and the continuity of limb rehabilitation training is ensured.

Description

technical field [0001] The invention relates to the field of medical technology, in particular to an attention-guiding virtual reality system for multisensory information fusion. Background technique [0002] Cognitive impairment is one of the most persistent and severe symptoms after stroke, and about 67% of stroke patients will experience cognitive impairment. Among the cognitive impairments in stroke, attention deficit is the most prominent. The presence of attention deficit reduces the efficiency of the patient's limb rehabilitation training. In the physical rehabilitation training of patients with attention disorders, the therapist generally reminds the patients to concentrate and maintain attention, otherwise the physical rehabilitation training will not continue. [0003] The virtual reality (VR) system enables people to complete lifelike, natural and smooth interaction in the virtual reality environment by providing multi-sensory information such as vision, hearing...

AI Technical Summary

Problems solved by technology

[0006] The above two programs focus on the rehabilitation and evaluation of attention, and are not suitable for attention guidance in limb rehabilitation training

Images