Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Crowd-information-fused speech emotion recognition method and system

A technology of speech emotion recognition and crowd information, applied in speech analysis, instruments, etc., can solve the problems of poor generalization and low recognition rate of emotion recognition, and achieve the effect of improving the overall accuracy

Active Publication Date: 2021-04-27
ZHEJIANG LAB
View PDF7 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the current technology, because only the shallow information of speech is considered and a simple network structure is used, the recognition rate of emotion recognition is relatively low, and the generalization is relatively poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crowd-information-fused speech emotion recognition method and system
  • Crowd-information-fused speech emotion recognition method and system
  • Crowd-information-fused speech emotion recognition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] In order to make the purpose, technical solution and technical effect of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0056] Such as figure 1 As shown, a speech emotion recognition system that integrates crowd information includes:

[0057] The voice signal acquisition module is used to collect user voice signals, generally using a high-fidelity single microphone or microphone array to reduce the distortion of voice signal acquisition;

[0058] The voice signal preprocessing module is used to preprocess the collected voice signal, detect the endpoint of the voice, remove the silent segment before and after the voice, and generate data that can be used for neural network processing. Specifically: the module pre-emphasizes the voice , framing, windowing, short-time Fourier transform, trigonometric function filtering, silence removal and other operations, convert the speech ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of artificial intelligence, and particularly relates to a crowd-information-fused speech emotion recognition method and system, and the method comprises the following steps: S1, collecting a user speech signal; S2, preprocessing the voice signal to obtain a Mel spectrum; S3, cutting off mute sections before and after the Mel spectrum; S4, acquiring deep crowd information through a crowd classification network; S5, acquiring Mel spectrum depth information through a Mel spectrum preprocessing network; S6, obtaining fusion information through the SENet fusion features; and S7, obtaining an emotion recognition structure through the classification network. According to the method, crowd information features are fused, so that emotion feature extraction is more accurate; and information fusion is carried out through an SENet channel attention mechanism, so that deep feature extraction can be effectively carried out, and the overall recognition precision is improved.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a speech emotion recognition method and system for fusing crowd information. Background technique [0002] Language interaction is one of the earliest ways of human communication, so speech has become the main way for humans to express emotions. With the rise of human-computer interaction, intelligent speech sentiment analysis is becoming more and more important. At present, the main classification of emotions is the seven emotions proposed by Ekman in the last century, namely: neutral, happy, sad, angry, afraid, disgusted, and surprised. [0003] The current mainstream speech emotion recognition methods are based on traditional algorithms or deep learning methods based on simple neural network architectures. The basic process based on the traditional method is: feature extraction of speech, and emotion classification of speech through features. Among them, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L25/63G10L25/30G10L25/24
CPCG10L25/63G10L25/30G10L25/24G06N3/045G06N3/0442G10L25/18G10L25/21
Inventor 李太豪郑书凯刘昱龙裴冠雄马诗洁谢冰
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products