Lip state recognition-based intelligent wheelchair human-computer interaction system and method

Abstract

The invention discloses a lip state recognition-based intelligent wheelchair human-computer interaction system and method, and relates to the field of computer vision and artificial intelligence. A lip is detected through a skin color model and an Adaboost algorithm, the specific position of the lip is marked, and the movement direction (advance, retreat, left turn and right turn) to be executed by an intelligent wheelchair is judged according to the relative position of the lip region. On the basis of the lip detection, the opening and closing state of the lip is judged by using an SVM (Support Vector Machine) algorithm. The lip position and the lip opening and closing state are combined so as to realize movement control over the intelligent wheelchair. The interference caused to the movement control over the wheelchair by unconscious movement of a head and an external environment is overcome, and the robustness of the human-computer interaction system is greatly improved.

Description

technical field [0001] The invention belongs to the field of artificial intelligence and computer vision, and in particular relates to a human-computer interaction system and method of an intelligent wheelchair. Background technique [0002] At present, the number of elderly people in the world is increasing, and this issue has attracted widespread attention from all walks of life; at the same time, the number of disabled people caused by various disasters, car accidents, diseases and other related factors is also increasing. Their mobility, reaction speed, and thinking ability will be lower than normal people. Therefore, providing superior mobility tools for the elderly and disabled has become one of the key concerns of the entire society. Smart wheelchair is a device that integrates various research fields and applies robot technology to electric wheelchairs. It can sense the external environment and process environmental information to obtain reasonable control decisions...

AI Technical Summary

Problems solved by technology

However, when the movement of the user's head or face is widely used to express the user's intention, when applied to the human-computer interaction system, the system often has some defects: when the person expects to move in a certain direction, the head will naturally look in that direction

But when an obstacle is approaching the user, the user will look at the obstacle, and the wheelchair will still move towards the obstacle

In fact, at this time, the user needs to avoid obstacles quickly, and the wheelchair will generate an error command at this time.

Images