Braille interaction system based on ultrasonic touch and interaction method thereof

Abstract

The invention discloses a braille interaction system based on ultrasonic tactile sensation and an interaction method thereof. The braille interaction system comprises an upper computer, a vision-basedhand position tracking detection module, a main controller and an ultrasonic array tactile sensation generation circuit. The vision-based hand position tracking detection module comprises a depth camera and a communication transmission circuit, the ultrasonic array tactile sensation generation circuit comprises a driving circuit and an ultrasonic array, and the main controller comprises a main control unit, a signal generation circuit unit and a camera signal acquisition unit. According to the invention, the hand position tracking detection module based on vision is reasonably combined with the ultrasonic array touch generation circuit. The three-dimensional interactive robot can work and operate independently and track the hand position, non-contact tactile feedback is generated in the three-dimensional space in real time, a new interactive experience is brought to the man-machine interaction mode of a blind person group, and the three-dimensional interactive robot has the advantagesof being high in real-time performance, high in precision, low in cost and the like, good in user experience, simple in overall structure, easy to achieve and beneficial to wide application and popularization.

Description

technical field [0001] The invention relates to the technical field of braille interaction based on ultrasonic tactile sensation, in particular to a braille interactive system and an interaction method based on ultrasonic tactile sensation. Background technique [0002] As one of the five senses of human beings, touch often does not attract people's attention and attention compared with vision, hearing, taste, etc. However, it plays a vital role all the time in various scenarios. In the process of human-computer interaction, its importance is even more self-evident. A 2015 Microsoft study showed that when typing on a touch screen with vibration haptic feedback, typing speed will be faster and error rate will be lower. It can be seen that the sense of touch is important in the process of human-computer interaction. Especially for the blind group, the sense of touch is an important reliance for them to maintain their basic life. This is because the sense of touch is rich in ...

AI Technical Summary

Problems solved by technology

However, since the patented hand position scanning circuit and the tactile feedback transmitting circuit use the same circuit, they cannot work at the same time. When the hand position changes, in order to obtain the hand position again, the tactile feedback transmitting function must be interrupted

On the other hand, its hand position scanning circuit can’t actually distinguish whether it’s the palm, the wrist, or other objects, and it’s vulnerable to external interference during actual use.

Images