Sound coding method of auxiliary perception system based on sensory substitution

Abstract

The invention discloses a sound coding method of an auxiliary perception system based on sensory substitution. The method comprises the steps of identifying attribute information used for representing object features, wherein the attribute information comprises a category attribute, a size attribute, a speed attribute and a moving direction attribute, and a baseband signal frequency domain waveform is selected according to the category attribute; identifying the current scene information of the target object, setting the priority of the target object according to the scene information, and selecting the center frequency of the corresponding baseband waveform; selecting a baseband frequency domain signal width according to the size of the target object; setting a sound cycle number according to the speed attribute of the target object; determining the position change in a three-dimensional space according to the moving direction attribute of the target object, reconstructing a three-dimensional sound field, and putting the reconstructed sound field into a ready sound library; and according to the priority of the target object, selecting the sound placed on the audio track from the ready sound library for playing. According to the invention, a visually impaired person can accurately perceive the surrounding environment through sound recognition.

Description

technical field [0001] The present invention relates to the technical field of information processing, and more specifically, relates to a sound coding method based on a sensory replacement assisted perception system. Background technique [0002] With the advancement of social science and technology and the improvement of medical level, among the visually impaired people who are blind due to retinal surgery, they have been able to restore their vision through surgical transplantation of the retina. There is no relevant treatment for the handicapped. Although genetic screening technology has reduced the birth rate of disabled babies in recent years, with the growth of the population base and the improvement of life expectancy, the number of disabled babies is still increasing year by year, and the number of blind people is also increasing year by year. Therefore, it is of great significance to use existing technology to help blind people perceive the outside world. [0003...

AI Technical Summary

Problems solved by technology

These methods are all based on the transformation corresponding to the pixel points of the picture. Such transformation will produce a lot of information redundancy for the blind, thus affecting the effect of sensory substitution.

Images