Video emotion recognition method and device based on time sequence multi-model fusion modeling and medium

Abstract

The invention discloses a video emotion recognition method based on time sequence multi-model fusion modeling, and the method comprises the steps: selecting a data set in a video emotion database as atraining data set, and carrying out the preprocessing of the training data set; constructing a convolutional neural network model based on a feature sampling structure according to the preprocessed training data set; constructing a long-short-term memory network model based on an attention mechanism according to the video spatial feature sequence extracted by the convolutional neural network model; and fusing the convolutional neural network model and the long-term and short-term memory network model to obtain a video emotion recognition model. According to the video emotion recognition method based on time sequence multi-model fusion modeling provided by the embodiment of the invention, the accuracy of video emotion recognition can be effectively improved through the video emotion recognition model constructed by fusing the time sequence feature modeling and other models.

Description

technical field [0001] The present invention relates to the technical field of data mining, in particular to a video emotion recognition method, device and storage medium based on time series multi-model fusion modeling. Background technique [0002] The breakthroughs in artificial intelligence technology in the fields of computer vision, speech recognition, and natural language processing have promoted the development of the field of human-computer emotional interaction. The exploration of human-computer emotional interaction methods with emotional understanding and expression ability has gradually become a research hotspot in the field of human-computer interaction. As a cross-field research topic, video emotion recognition research is of great significance for promoting the development of human-computer emotional interaction technology and mining the emotional value of massive video data. [0003] In the research and practice of the prior art, the inventors of the presen...

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a video emotion recognition method based on time-series multi-model fusion modeling to solve the technical problem of low accuracy of existing video emotion recognition. The present invention builds a video emotion recognition model by fusing models such as time-series feature modeling , can effectively improve the accuracy of video emotion recognition

Images