Multi-sensory-mode BCI-VR control method and system and VR equipment
A control method and multi-sensory technology, applied in the field of BCI-VR control of VR equipment and multi-sensory modalities, can solve problems such as scenarios where BCI is difficult to apply multi-sensory information input, and achieve improved user experience, enhanced user experience, and broad The effect of the application foreground
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0044] see figure 1 , the present embodiment provides a multi-sensory mode BCI-VR control method, including steps:
[0045] S1. Acquire an EEG signal, which is triggered by a VR scene and includes sensory signals corresponding to different sensory modalities.
[0046] VR (Virtual Reality, Virtual Reality) is a computer simulation system that provides users with an immersive three-dimensional virtual reality environment and a variety of sensory simulation experiences. The VR scene is a target object constructed based on virtual reality technology.
[0047] In this embodiment, different sensory modalities may include visual modalities, auditory modalities, and motor imagery modalities; correspondingly, EEG signals include SSVEP visual signals, P300 auditory signals, and MI motor imagery signals corresponding to the above sensory modalities.
[0048] S2. Perform feature extraction and classification recognition processing on the sensory signals, and obtain EEG classification inf...
Embodiment 2
[0090] see figure 2 , the present invention provides a multi-sensory modality BCI-VR system, as attached image 3 As shown, the multi-sensory BCI-VR system includes: an acquisition module 100 , an information preprocessing module 200 , an information processing module 300 , an information combination module 400 and a trigger module 500 .
[0091]Wherein, the acquisition module 100 is used to acquire EEG signals; the EEG signals are triggered by VR scenes and include sensory signals corresponding to different sensory modalities; wherein, in this embodiment 1, different sensory modalities include: visual modalities, auditory modalities The EEG signal includes one-to-one corresponding SSVEP visual signal, P300 auditory signal and MI motor imagery signal.
[0092] The VR scene is a target object constructed based on virtual reality technology; different target objects flicker according to different flicker frequencies, and flicker triggers the brain to generate SSVEP visual sign...
Embodiment 3
[0121] This embodiment provides a VR device, including the multi-sensory BCI-VR system in Embodiment 2. Preferably, the VR device is a VR game device. see image 3 , shows an application schematic diagram of a VR game device.
[0122] Specifically, in an application scenario, the VR game device constructs a virtual protagonist and target objects based on the game scene type of the VR game; different virtual protagonists and target objects flash according to different flicker frequencies, such as the left hand, right hand, The head and feet flicker at different flicker frequencies to trigger the brain to generate SSVEP visual signals corresponding to the visual sensory modes. The left hand, right hand, head and feet of the virtual protagonist are stimulated according to different low-probability sound frequencies to trigger the brain to generate auditory sensory modes. Corresponding to the P300 auditory signal, the user also generates a motor imagery MI signal. Based on the ...
PUM
Property | Measurement | Unit |
---|---|---|
Impedance | aaaaa | aaaaa |
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com