A multi-modal neural decoding control system and method for on-orbit operation of a space manipulator

A space robotic arm and neural decoding technology, applied in the field of multi-modal neural decoding control system, can solve the problems of single biological information and few tasks, achieve good human-computer interaction effect, improve stability and reliability, and reduce errors. The effect of the possibility of operation

Active Publication Date: 2022-04-01
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the biological information involved is relatively simple, and the tasks to be achieved are few

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-modal neural decoding control system and method for on-orbit operation of a space manipulator
  • A multi-modal neural decoding control system and method for on-orbit operation of a space manipulator
  • A multi-modal neural decoding control system and method for on-orbit operation of a space manipulator

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Below, the present invention will be described in further detail in conjunction with the accompanying drawings.

[0041] The invention applies the brain-eye tracking technology to the attitude stabilization control of the space manipulator in the weightless environment. Brain-eye movement control, as a new type of control method, gets rid of the requirements for body movements, breaks through the limitations of relying on astronauts to operate mouse keyboards, joysticks and other traditional manual controls, and eliminates the physical inconvenience caused by the weightlessness of space. Or the input obstacles encountered when interacting with the space manipulator due to reasons such as limited environment, realize two-way multi-mode human-computer interaction, complete the capture of failed satellites by the space manipulator in space, or complete the equipment operation of the space station, and enhance our country’s ability in space. advantages in the field.

[004...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-mode neural decoding control system and method for on-orbit operation of a space manipulator, which uses Emotiv Epoc+ electroencephalography to collect electroencephalogram signals and oculoelectric signals, and uses a microphone that comes with a computer to collect voice signals; the mode The recognition module fuses and decodes four types of EEG signals and four types of voice signals to identify conscious eye blinking signals; the control module transfers the fusion decoding results of EEG signals and voice signals and conscious eye blinking signals into the built unity environment through UDP network communication, Convert it into a control signal to control the movement of the space manipulator in the virtual environment and grab the target item. Aiming at the weightlessness of astronauts in space, the invention adopts the method of controlling the movement of the space manipulator in the virtual environment through biological information to complete the task of moving the designated target and achieve better human-machine interaction effect.

Description

technical field [0001] The invention relates to human-computer interaction intelligent control technology, in particular to a multi-modal neural decoding control system and method for on-orbit operation of a space manipulator. Background technique [0002] As a space station, a space station is a giant satellite placed in space and fixed in orbit for a long time to carry out various space activities and form a multi-purpose space center. In actual operation, the space station can dock with multiple spacecraft at the same time to form a large orbital complex. The various advantages of the space station are not only used in scientific experiments, but also in the military field. It has unique military application functions. The space robot arm plays a huge role in the normal operation of the space station. [0003] Early space manipulators were controlled through keyboards, buttons, and teaching boxes, and the operations were complex and could only complete simple tasks. In ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): B25J9/16
CPCB25J9/1602B25J9/1697B25J9/1664
Inventor 曲思霖王从庆展文豪李建亮
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products