Auxiliary perception method and system based on sensory substitution

Abstract

The invention provides an auxiliary perception method and system based on sensory substitution. The method comprises the following steps: establishing a discrete horizontal plane included angle and anormal vector included angle in a three-dimensional space, and response functions corresponding to different discrete distances, and establishing a sound coding library of an object; acquiring a surrounding environment video; performing object detection on each frame of visual image to obtain the object information and category of the current environment, and calculating the three-dimensional coordinate position of each object away from the visual input unit according to the visual image information of each frame; according to the obtained image information, object information and three-dimensional coordinate information, establishing a three-dimensional sound field of the object in combination with a sound coding library of the object; and for different types of objects, adjusting the three-dimensional sound field of each object according to the change of the motion information and the image, and playing the three-dimensional sound field of each object in real time. According to the invention, by use of a sensory substitution mode, external information is converted into a sound signal through a modeling method, and auxiliary perception is facilitated.

Description

technical field [0001] The invention relates to the technical field of sensory substitution, in particular to a method and system for assisted perception based on sensory substitution. Background technique [0002] With the advancement of social science and technology and the improvement of medical level, among the visually impaired people who are blind due to retinal surgery, they have been able to restore their vision through surgical transplantation of the retina. However, among these visually impaired people, there is another group, the visual pathway nerve There is no treatment for visually impaired people who have problems. Although genetic screening technology has reduced the birth rate of disabled babies in recent years, with the growth of the population base and the improvement of life expectancy, the number of disabled babies is still increasing year by year, and the number of blind people is also increasing year by year . Therefore, helping the blind to perceive...

AI Technical Summary

Problems solved by technology

These methods are all based on the transformation corresponding to the pixel points of the picture. Such transformation will produce a lot of information redundancy for the blind, making the sensory substitution fail.

Images