Character input method based on combination of brain signals and voice

Abstract

The invention discloses a character input method based on combination of brain signals and voice. The method comprises the following specific steps: system initialization: a user wears an electrode cap, applies conductive paste, connects the electrode cap with an amplifier, connects the amplifier to a computer, starts electroencephalogram acquisition software, and sets parameters; then the microphone is connected to a computer; brain signal input: a stimulation normal form interface of an induction stimulation module is started and collection of training data is carried out, wherein in the spelling process of each character, the P300 buttons flicker by n rounds, wherein 44 P300 buttons in each round flicker once according to a random sequence. According to the method, the defects of an existing character input method in the brain-computer field are overcome, a brain signal and voice signal input method is adopted, the brain-computer interface technology and the voice recognition technology are combined, the flexibility of the character input method is greatly improved, and meanwhile the character input efficiency is greatly improved.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a character input method based on the combination of brain signals and speech. Background technique [0002] At present, the society pays more and more attention to the disabled, and how to improve the quality of life of the disabled has become a hot topic of discussion. In order to help disabled patients to better interact with the outside world, the current character input methods are investigated and analyzed as follows: [0003] The invention with the application number 201110269640.9 "A Design Scheme of a Virtual Keyboard for Inputting Chinese Characters Using Brain Waves" and the invention with the application number 201710582561.0 "Efficient Brain-Controlled Chinese Input Method Based on Motor Visual Evoked Potentials" both simply use brain-computer interface technology To realize character input, for disabled patients, the character input m...

AI Technical Summary

Problems solved by technology

[0003] The invention with the application number 201110269640.9 "A Design Scheme of a Virtual Keyboard for Inputting Chinese Characters Using Brain Waves" and the invention with the application number 201710582561.0 "Efficient Brain-Controlled Chinese Input Method Based on Motor Visual Evoked Potentials" both simply use brain-computer interface technology To realize character input, for disabled patients, the character input method implemented by using brain-computer interface technology has the following disadvantages: (1) Chinese input needs to use pinyin or strokes for multi-step spelling input, the steps are cumbersome, and it takes a long time to input a Chinese character. Long, timeliness cannot be guaranteed

(2) Long-term operation will make the user feel tired, and the accuracy of the user's operation in the fatigued state will also decrease accordingly. The input is unstable and the accuracy cannot be guaranteed.

Due to the limitations of accuracy and timeliness in character input purely relying on brain-computer interface technology, although pure speech recognition technology has high input efficiency, there are also problems with accuracy.

Images