Wheelchair mechanical arm integrated system based on electrooculography and machine vision and control method thereof

Abstract

The invention discloses a wheelchair mechanical arm integrated system based on electrooculography and machine vision, which comprises an EOG (electrooculogram) acquisition amplifier, a graphical userinterface, a multi-eye movement EOG signal detection and identification unit, a target object detection unit, a comprehensive identification unit and an execution unit; the invention also discloses awheelchair mechanical arm integrated control method based on electrooculography and machine vision; in a human-machine interface instruction output mode based on two eye movements disclosed by the invention, at the premise that interference caused by unconscious eye movements is eliminated, average response time for generating an instruction is shortened to about 2 seconds, a user can output 14 different instructions through eye movements, and the accuracy can reach 97.3% on average while the accuracy of the conventional wheelchair control technology based on electrooculography is up to 80%; compared with the existing human-machine interface based on EOG, this mode has greatly improved performance; human brain intelligence reflected by electrooculogram is combined with machine intelligence, so that the control accuracy is guaranteed, and the operating load of a user is reduced.

Description

technical field [0001] The invention belongs to the field of human-computer interaction technology, and in particular relates to an integrated system of a wheelchair manipulator based on electro-oculogram and machine vision, and also relates to an integrated control method of a wheelchair manipulator based on electro-oculogram and machine vision. Background technique [0002] For paralyzed patients with limited limbs, such as those with spinal cord injuries, external assistance is necessary to perform everyday tasks such as locomotion and grasping, which require the participation of limbs. Usually, the nurses or family members who care for these patients will assist them in completing some necessary exercises to meet their daily needs. However, this kind of nursing work will take up a lot of time and energy of the nursing staff. Many family members even quit their jobs and stay at home or in the ward, just to take care of the patients around the clock. In order to reduce th...

AI Technical Summary

Problems solved by technology

[0007] (ii) The load of the control integrated system is much higher than that of the single control system, which is easy to cause fatigue, and measures need to be taken to reduce the task load

Images