A Multi-Channel Speech Enhancement Method with Semantic Prior Based Selective Attention

Abstract

The invention provides a multi-channel speech enhancement method based on semantic prior selective attention. The method comprises the following steps: picking speech signals from any directions in a reverberant environment by virtue of a multi-microphone array, collecting the multiple paths of speech signals and pre-processing the speech signals; detecting special activation words in the pre-processed speech signals by virtue of an activation word speech recognition model; processing signals which are not cut and include activation word segments, so as to obtain a complete activation word segment; analyzing the activation word segment by virtue of a multi-channel phase difference sound localization method based on reverberation robust, so as to obtain an acoustic wave reaching direction of a target sound source; and enhancing speech in the direction and inhibiting noise from other directions and room reverberation in a remote speak scene, so that enhanced speech in the target direction is obtained. The method provided by the invention is applicable to such occasions as intelligent household electrical appliance, smart home, vehicle-mounted and wearable devices and the like that remote speak type speech input and interaction are required, and the method is especially applicable to complex acoustic noise and interference environment occasions.

Description

technical field [0001] The invention relates to the field of speech processing, in particular to a multi-channel speech enhancement method based on semantic prior selective attention. Background technique [0002] With the continuous popularization of voice communication and human-computer voice interaction systems, people are increasingly looking forward to abandoning cumbersome equipment such as microphones and earphones to realize human-machine voice communication that is as natural as human dialogue. However, speech is a sound wave that is affected by various effects when transmitted in the air, such as attenuation of the sound wave, multiple reflections (reverberation) from walls and obstacles, the presence of other sound sources and environmental noise, etc. at the same time. When multiple voice systems and multiple speakers are in the same environment, how to ensure that the system receives voice information correctly determines whether the voice system can be practic...

AI Technical Summary

Problems solved by technology

In reverberant fields with room reflections, the situation is more complicated, resulting in excessive noise from the target sound source

Images