Video emotion identification method based on emotion significant feature integration

Abstract

The invention discloses a video emotion identification method based on emotion significant feature integration. A training video set is acquired, and video cameras are extracted from a video. An emotion key frame is selected for each video camera. The audio feature and the visual emotion feature of each video camera in the training video set are extracted. The audio feature is based on a word package model and forms an emotion distribution histogram feature. The visual emotion feature is based on a visual dictionary and forms an emotion attention feature. The emotion attention feature and the emotion distribution histogram feature are integrated from top to bottom to form a video feature with emotion significance. The video feature with emotion significance is sent into an SVM classifier for training, wherein the video feature is formed in the training video set. Parameters of a training model are acquired. The training model is used for predicting the emotion category of a tested video. An integration algorithm provided by the invention has the advantages of simple realization, mature and reliable trainer and quick prediction, and can efficiently complete a video emotion identification process.

Description

Technical field [0001] The present invention relates to the fields of multimedia content understanding and computer network content retrieval, in particular to a video emotion recognition method based on the fusion of emotional saliency features. Background technique [0002] With the rapid development of computer technology, communication technology and multimedia technology, the Internet has become a vast and massive multimedia information source. People are eager to use computers to automatically understand the rapidly growing digital image / video information, so as to facilitate users to choose effective The technical means to effectively organize, manage and search these visual information. Content-based video retrieval has become an important research topic. Among them, the video retrieval research on the cognitive level has been carried out earlier, and many feasible algorithms have emerged. However, video retrieval research based on sentiment analysis has not received mu...

AI Technical Summary

Problems solved by technology

Video is a kind of multimedia, which includes feature data such as language, sound, and image. However, in the existing research, there is no in-depth research on the fusion of video multimedia features, which leads to the indiscrimination of video emotional features, which affects video classification. and recognition accuracy

Images