Brain-computer cooperation digital twinning reinforcement learning control method and system

A collaborative control and reinforcement learning technology, applied in the field of brain-computer interface and artificial intelligence integration, can solve the lack of brain-computer dual-loop interaction mechanism, poor performance of brain-computer hybrid intelligent system, distraction and mental load, etc. problem, to achieve the effect of improving robustness and generalization ability, good transferability, and realizing mutual adaptation

Active Publication Date: 2021-01-05
XI AN JIAOTONG UNIV
View PDF7 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] After research, it is found that there are still two problems in the field of precision control: (1) the lack of two-way interaction of information between the operator and the robot, and the inability to realize the precise perception of the operator's intention; (2) due to the distraction of the human brain , mental fatigue and excessive mental load, etc., resulting in poor performance of the brain-computer hybrid intelligent system, and even danger
In view of the deterioration of the performance of the brain-computer system caused by the mental state o...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Brain-computer cooperation digital twinning reinforcement learning control method and system
  • Brain-computer cooperation digital twinning reinforcement learning control method and system
  • Brain-computer cooperation digital twinning reinforcement learning control method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0047] Transplant the trained model to the controller of the physical robot to realize the precise control of the brain-computer cooperation of the physical robot. At the same time, during the control process, the real environment and the virtual environment are fully synchronized by using digital twin technology, and the parameters of the physical robot controller are corrected in real time.

[0048] Step 1: Build a real physical environment to control the robot. Compared with the virtual training platform, except that the controlled object is a physical robot, other operating objects are the same;

[0049] Step 2: The control starts, and the operator sends a direction command C through the control device at time t t For the physical robot; at the same time, collect the brain surface EEG signal 600ms before time t; the location of the EEG cap channel is in line with the international 10 / 20 standard, and the electrodes are arranged on Fp1, Fp2, Fz, F3, F4, F7, F8, FC1 , FC2, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a brain-computer cooperation digital twinning reinforcement learning control method and system. A brain-computer cooperation control model is constructed, an operator gives a virtual robot direction instruction, meanwhile, an electroencephalogram signal generated when the operator gives the virtual robot direction instruction is collected, a corresponding speed instructionof a virtual robot is given according to the collected electroencephalogram signal to complete a specified action, reward value calculation is performed on the brain-computer cooperation control modelaccording to the completion quality, training of the brain-computer cooperation control model is completed, a double-loop information interaction mechanism between the brain and the computer is realized through a brain-computer cooperation digital twinning environment in a reinforced learning manner, and interaction of an information layer and an instruction layer between the brain and the computer is realized. According to the method and the system, the brain state of the operator is detected through the electroencephalogram signals, compensation control is conducted on the instruction of the robot according to the brain state of the operator, accurate control is achieved, and compared with other brain-computer cooperation methods, the method has the advantages that the robustness and generalization ability are improved, and mutual adaptation and mutual growth between the brain and the computers are achieved.

Description

technical field [0001] The invention belongs to the field of brain-computer interface and artificial intelligence comprehensive technology, and relates to a brain-computer cooperative digital twin reinforcement learning control method and system. Background technique [0002] With the development of robotics technology, there is an increasingly urgent demand for intelligent robots with human-like advanced perception and cognition capabilities and the ability to perform non-set tasks in highly complex environments. However, to achieve intelligent robots with human thinking and reasoning methods, autonomous discovery and feature extraction, online incremental learning, and comprehensive processing of various information capabilities only with artificial intelligence technology, the current technology is still not up to it. Utilizing the fusion of human-machine intelligence and giving full play to the advantages of different intelligences of humans and computers is an important...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J9/16G06F3/01
CPCB25J9/1602B25J9/163B25J9/1664G06F3/015
Inventor 张小栋张腾陆竹风张毅蒋志明王雅纯朱文静蒋永玉
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products