Method for realizing virtual mouse by combining eye tracker and asynchronous motor imagery technology

Abstract

The invention provides a method for realizing a virtual mouse by combining an eye tracker and an asynchronous motor imagery technology. The method comprises the following steps: S1, realizing a moving function of the mouse through an eye movement signal: collecting a visual track of a user in real time through the eye tracker to obtain a coordinate of an eye movement fixation point of the user, performing data processing on the coordinates of the eye movement fixation point of the user, and establishing association between the pointer position of the virtual mouse and the visual track of the user to realize the moving function of the virtual mouse; S2, realizing a left and right key clicking function of the mouse through motor imagery: a user imagines actions associated with the left and right keys, and realizes the left and right key clicking function of the mouse by decoding the brain wave signal of the motion area. According to the method, the eye tracker and the asynchronous motor imagery technology are combined to realize target selection of the virtual mouse, so that a user can realize remote control on a computer only by eyes and brain without taking any action.

Description

technical field [0001] The invention relates to the technical fields of brain science and cognitive science, in particular to a method for realizing a virtual mouse in combination with an eye tracker and asynchronous motion imagery technology. Background technique [0002] Brain computer interface (BCI) is an interactive system built between humans and machines. Generally, the signal acquisition of brain-computer interface can be divided into three types: non-invasive, semi-invasive and invasive. Among them, the non-invasive method may be the first to be applied to real life in the future because it does not cause harm to the human body. According to whether the EEG signal is caused by external stimuli, BCI technology can be divided into evoked and spontaneous. Common evoked BCI technologies include steady-state visual evoked potential (SSVEP) and event-related potential (ERP). SSVEP is mainly a method for judging the intention of the subject when the subject gazes at a v...

AI Technical Summary

Problems solved by technology

However, because it can only track the gaze trajectory of the human eye, and does not have functions such as confirmation, its practical use in daily life is very limited. It is usually used for games or professional psychological analysis.

Images