Memory and attention model-based auditory selection method and device

Abstract

The invention belongs to the technical field of speech separation and particularly relates to a memory and attention model-based auditory selection method and device, so as to solve the problems of supervision label arrangement, speaker aliasing number uncertainty and memory unit dimension fixation in the prior art. The memory and attention model-based auditory selection method comprises steps: original speech signals are coded as a time frequency matrix, the time frequency matrix is subjected to coding and transformation, the time frequency matrix is converted to speech vectors, a long term memory unit is used to store speakers and corresponding speech vectors, the speech vector of a target speaker is acquired, and target speech is separated from the original speech signals through an attention selection model. The method provided in the invention does not need to fix or designate the number of speakers but can separate the target speech from the original speech signals.

Description

technical field [0001] The invention belongs to the technical field of speech separation, and in particular relates to an auditory selection method and device based on memory and attention models. Background technique [0002] In recent years, with the rapid development of electronic equipment and artificial intelligence, human-computer voice interaction, as an important part of the field of artificial intelligence, has become increasingly important, and human-computer voice interaction has been widely used in real life. Human-computer voice interaction is the machine recognition and analysis to extract the semantic feature information of the voice signal, compare it with the semantic features in the standard information base, and output the corresponding text or convert it into the output result we want. However, in practical applications, there are a lot of interference in the real environment, and the process of machine recognition, analysis and extraction of semantic fea...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above problems in the prior art, that is, in order to solve the problems of the arrangement of supervised labels, the uncertain number of speaker aliasing and the fixed dimension of the memory unit in the prior art, an aspect of the present invention provides a method based on memory and attention. Auditory selection methods for force models, including:

Images