Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A user interface interaction method, device and computer equipment

An interaction method and user interface technology, applied in the input/output of user/computer interaction, computer parts, computing, etc., can solve the problems of single type of classification model and lack of both models, and achieve faster speed and enrich human-computer Effects of Interaction Kinds

Active Publication Date: 2022-07-26
上海菁存智测医疗科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] At present, the types of classification models used in human-computer interaction based on eye movement technology and hybrid brain-computer technology are single, and the models of the two technologies are not compatible.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A user interface interaction method, device and computer equipment
  • A user interface interaction method, device and computer equipment
  • A user interface interaction method, device and computer equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] like figure 1 As shown, the present invention provides a user interface interaction method, comprising the following steps:

[0063] Step 101: Collect the user's eye movement signal, EEG signal and EMG signal; specifically, the signal collection method is: the user wears a non-invasive EEG device (for example, wears an EEG cap) to collect the EEG signal and EMG signal , the non-invasive eye tracker located below the display records the user's eye movement signal (format: time-x-coordinate-y-coordinate).

[0064] Step 102, analyze and process the eye movement signal, EEG signal and EMG signal according to the collected eye movement signal, EEG signal and EMG signal; it should be explained that in the eye movement signal processing, SVM (support vector machine) fitting the attention index function to give the current user attention level. In the fusion processing of EEG signals, EMG signals, and eye movement signals, the LSTM (Long Short-Term Memory Network) model is us...

Embodiment 2

[0151] The present invention discloses and provides a user interface interaction method and device, comprising:

[0152] The acquisition module is used to collect the user's eye movement signal, EEG signal and EMG signal;

[0153] The processing module is used for analyzing and processing the eye movement signal, EEG signal and EMG signal according to the collected eye movement signal, EEG signal and EMG signal;

[0154] The display and control module is used to display the analysis results and output the real-time control results according to the analysis and processing of the eye movement signal, the EEG signal and the EMG signal.

[0155] Further, the processing module includes

[0156] The eye movement preprocessing unit is used to preprocess the characteristic parameters of the collected eye movement signal;

[0157] The eye movement processing unit is used to extract the time series of potential eye movement behaviors from the preprocessed eye movement signal by using ...

Embodiment 3

[0169] Embodiment 5 of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the program, any one of the above methods is implemented.

[0170] The computer device of this embodiment includes a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a resource issuance program. When the processor executes the computer program, the steps in each of the foregoing user interface interaction method embodiments are implemented. Alternatively, when the processor executes the computer program, the functions of the modules / units in the foregoing device embodiments are implemented.

[0171]Exemplarily, the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the memory and executed by the processor to accomplish the present invention. The one or mor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a user interface interaction method, device and computer equipment, wherein the method includes the following steps: collecting user's eye movement signal, brain electrical signal and electromyography signal; Signal, analyze and process eye movement signal, EEG signal and EMG signal; display analysis results and output real-time control results according to the analysis and processing of eye movement signal, EEG signal and EMG signal. The invention discloses a user interface interaction method, which is a user interface interaction method under the hybrid EEG-line-of-sight human-computer interaction. The hybrid brain-computer signal processing technology is used to effectively and quickly realize the training of the model and accelerate the reduction of the model loss value during training. , real-time and stable realization of the hybrid EEG modality fused with EMG; real-time and stable realization of the eye-moving human-computer interaction mode. Based on the two modes, an instruction set composed of different paradigms is constructed.

Description

technical field [0001] The present invention relates to human-computer interaction and signal analysis, in particular to a user interface interaction method, device and computer equipment. Background technique [0002] Human-Computer Interaction (HCI) refers to the process of information exchange between people and computers using a certain dialogue language and a certain interactive way to complete certain tasks. The difficulty of realizing human-computer interaction quickly and effectively lies in reducing human effort and realizing accurate control through simple operation. The devices that HCI can use for human-computer interaction mainly include keyboards, displays, and various pattern recognition devices. Pattern recognition has an extremely wide range of applications. According to different data types such as images, voices, and behaviors, relevant patterns and modal classifications are formulated to solve the problem of completing different instructions. [0003] N...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
CPCG06F3/013G06F3/015G06F2203/011
Inventor 蒋皆恢彭川江娟娟
Owner 上海菁存智测医疗科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com