Event detection method and device and electronic equipment

Abstract

The embodiment of the invention provides an event detection method and device and electronic equipment, and the method comprises the steps: extracting a multimedia frame sequence from a to-be-detectedmultimedia stream; performing optical flow analysis on the multimedia frame sequence to obtain an optical flow graph corresponding to each multimedia frame in the multimedia frame sequence; fusing each multimedia frame with the corresponding optical flow graph, and performing operation on an image sequence obtained after fusion through a convolutional neural network obtained by pre-training to obtain a spatial feature graph sequence carrying time sequence information; performing recursive operation on the spatial feature map sequence according to the time sequence information through a space-time recurrent neural network obtained by pre-training to obtain a space-time feature map sequence; and determining an event type in the multimedia stream by using a preset multi-classifier based on the time-space feature map sequence. Through the scheme, the detection of the universal event can be realized.

Description

technical field [0001] The present invention relates to the field of multimedia technology, in particular to an event detection method, device and electronic equipment. Background technique [0002] Event detection refers to determining the event type in the multimedia stream by analyzing and understanding the multimedia stream. Traditional event detection is to identify events in multimedia streams through manual detection. As the scene becomes more and more complex and multimedia data becomes larger and larger, manual detection requires a lot of labor and is affected by human factors. , there are inevitably problems such as low efficiency and high error rate. [0003] In order to deal with the above problems, in the corresponding event detection method, by adaptively dividing the moving points between multimedia frames into optical flow blocks, the moving points of the same target will be divided into the same optical flow block, for some For special events where the tar...

AI Technical Summary

Problems solved by technology

[0004] However, the above-mentioned event detection method can only detect events such as violent events that have the characteristics of target gathering, intense movement, and high conflict, but for general events such as fencing, cycling, running, etc., the event type cannot be detected.

Images