Virtual force feedback interaction system and method based on myoelectricity evaluation

An interactive system and virtual force technology, applied in the field of virtual force feedback interactive system based on myoelectric evaluation, can solve problems such as poor contact, stop, inconsistent force, etc., to simplify the size of circuit devices, enhance immersion, and improve realism degree of effect

Active Publication Date: 2020-09-29
SOUTH CHINA UNIV OF TECH
View PDF11 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, VR devices at home and abroad mainly have the following three deficiencies in the realization of force feedback interaction: 1. The development of interactive feedback technology that integrates vision and hearing is relatively mature, but in vision, haptic, and even visual, auditory, and haptic The interactive feedback technology of fusion processing needs to be improved urgently; Second, the realization of force feedback is mainly through traditional sensor vibration body surface or through mechanical structure to transmit force. In the "powerful" stage, it is impossible to finely provide force feedback with a specific strength, that is, the strength of the force feedback generated by the existing electrical stimulation methods on the human body cannot be controlled, and it is inconsistent with the force given to people by objects in the real world, which greatly reduces virtual stimulation. The sense of immersion in the scene; 3. Today’s force feedback electrodes often use silicone patch electrodes, which often face poor contact and easy to fall off, and are not suitable for popularization and application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual force feedback interaction system and method based on myoelectricity evaluation
  • Virtual force feedback interaction system and method based on myoelectricity evaluation
  • Virtual force feedback interaction system and method based on myoelectricity evaluation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0026] Such as figure 1 , the present invention includes an electrode or electrode array unit, an initial parameter generation unit, a myoelectric signal acquisition module, an electrical stimulation module, a time division multiplexing module and a myoelectric signal-force regression model processing unit. The initial parameter generation unit and the myoelectric signal-force regression model processing unit can be set in a local computer, a server or a VR device.

[0027] In this embodiment, the electrode or electrode array unit (also referred to as an electrode sensor) is a flexible fabric electrode array attached to multiple positions on the surface of the human skin (such as the muscle surface of the biceps brachii and triceps brachii). The fabric electrode array is embedded in the fabric base, and wrapped around human muscles with the fabric as a support, it can be made into an armband and worn on the arm. The electrode or electrode array unit is respectively connected ...

example 1

[0051]Example 1. The flexible electrode sensor is made into an arm ring, and it is symmetrically placed on the biceps, triceps, and latissimus dorsi of the left and right arms, and the electrode sensor at the biceps is used for To collect myoelectric signals, the electrode sensor at the triceps is electrically stimulated to provide the downward gravity of the virtual object, and the electrode sensor at the latissimus dorsi of the shoulder is also electrically stimulated to generate the force of the virtual object to open the hand outward . When the human body holds objects of different weights by hand, the biceps of the arm contracts to produce a sense of force. In this process, a dynamometer can be used to replace objects with different forces, and it is easy to measure the corresponding force when the human body actively contracts the muscles. The force generated by the biceps is upward. A large number of myoelectric signals are collected by flexible electrode sensors, and ...

example 2

[0052] Example 2, similar to the process of Example 1, a dynamometer can be used to replace objects with different forces, and it is easy to measure the force produced by the triceps of the human body. The force is downward, and the EMG-force regression model is established. Create a corresponding shooting scene in the virtual scene. When the user presses the pistol, the pistol will generate a certain amount of recoil on the human body, and the recoil force can be preset. In order to simulate the recoil of the pistol, the electrical stimulation module outputs electrical stimulation signals to stimulate the biceps of the human body, and the forearm is involuntarily lifted upwards. In order to experience the pressure gun, the triceps of the human body will actively contract and prevent the arm from being lifted up. At this time, the force generated by the triceps is the recoil force. The electric stimulation module is calibrated to output a new electric stimulation signal by col...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a virtual reality interaction technology, in particular to a virtual force feedback interaction system and method based on myoelectricity evaluation. The system comprises an electrode sensor, an initial parameter generation unit, an electromyographic signal acquisition module, an electrical stimulation module, a time division multiplexing module and an electromyographic signal-force regression model processing unit, a virtual interaction event triggers an initial parameter generation unit to generate an initial electrical stimulation signal parameter, and an initial electrical stimulation signal is sent to an electrode sensor to stimulate muscle passive contraction to generate passive force; the electromyographic signal acquisition module receives a human body mainpower electromyographic signal acquired by the electrode sensor in real time through the time division multiplexing module; the virtual force is input into an electromyographic signal-force regression model processing unit to predict and evaluate the virtual force, further parameters of the electrical stimulation signal are dynamically adjusted to output a new electrical stimulation signal, and the virtual force feedback is adjusted to be consistent with the force given by a real object. According to the system, feedback adjustment can be carried out on the virtual force, and the immersion ofa virtual scene is enhanced.

Description

technical field [0001] The invention relates to virtual reality interaction technology, in particular to a virtual force feedback interaction system and method based on myoelectric evaluation. Background technique [0002] With the development of science and technology, virtual reality (Virtual Reality) technology has been widely concerned and applied, especially in games, film and television, education, medical treatment and other aspects have broad prospects. VR technology gives users the most realistic feeling by simulating the real world, making people feel immersive. At the same time, VR technology provides the perception functions possessed by human beings, including hearing, vision, touch, etc., which can greatly improve the immersion in the virtual world. At present, VR has been able to provide us with an extremely realistic virtual world, but when we try to reach out and touch these virtual objects, the sense of reality brought by VR is instantly shattered, because...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01
CPCG06F3/016
Inventor 舒琳谢超阳徐向民朱齐
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products