Emotion recognition method and device, computer equipment and storage medium

Abstract

The invention relates to an emotion recognition method. The method comprises the steps of obtaining a first text feature in voice data and a corresponding first frequency cepstrum feature and a voiceprint feature; performing cross attention fusion on the first text feature and the first frequency cepstrum feature to obtain a second text feature and a second frequency cepstrum feature; encoding the second frequency cepstrum feature and the voiceprint feature to obtain a first audio encoding feature and a second audio encoding feature; encoding the first text feature and the second text feature to obtain a first text encoding feature and a second text encoding feature; performing multi-head attention fusion on the first audio coding feature and the first text coding feature to obtain a first fusion feature; obtaining a second fusion feature from the first fusion feature according to a dynamic routing algorithm; and obtaining an emotion recognition result according to the second fusion feature, the second text coding feature and the second audio coding feature. According to the method, the text features and the voice features corresponding to the voice data can be fully utilized, and high-precision emotion recognition is realized.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, and in particular, to an emotion recognition method, apparatus, computer equipment, storage medium and computer program product. Background technique [0002] With the rapid development of artificial intelligence and the help of deep learning, the field of human-computer interaction has received more and more attention from researchers. As an important branch of human-computer interaction, emotion recognition has also become a current hot research direction. At present, most of the research on emotion recognition focuses on single-modal fields such as speech, facial expressions, and text. As the most direct means of people's communication, speech contains rich emotional information, and changes in people's emotions can be reflected through speech features. Speech emotion recognition is to convert the input speech signal containing emotional information into readable ph...

AI Technical Summary

Problems solved by technology

However, when traditional technology fuses speech and text, the fusion method is relatively simple, resulting in low accuracy of emotion recognition

Images