Space-time behavior detection method

Abstract

The invention discloses a space-time behavior detection method, which comprises the following steps: carrying out object detection on all frames in a sample video to obtain a candidate object set; calculating all inter-frame optical flow information in the sample video, and obtaining a motion set; constructing a space-time convolution-deconvolution network for constructing additional object attention mechanism and motion attention mechanism; after performing space-time convolution processing on each time slice of the sample video, adding corresponding sparse variables and sparse constraints toobtain a network structure S; training the network structure S by taking the classification loss based on the cross entropy and the loss of the sparse constraint as objective functions; and calculating behavior types and sparse coefficients corresponding to the time slices in the test sample video, and obtaining an object behavior space-time position. According to the method, through object detection and optical flow prediction, the behavior search space is reduced, and space-time behavior detection has good robustness.

Description

technical field [0001] The invention belongs to the field of computer vision, and more specifically relates to a spatiotemporal behavior detection method. Background technique [0002] Behavior analysis is an important and active research hotspot in current computer vision. It not only has a wide range of applications in the field of social security, such as abnormal behavior detection in the monitoring environment, detection and recognition of theft in shopping malls, but also plays an important role in human-computer interaction. For example, service robots can effectively predict the behavior of the elderly to prevent accidents. In addition, they can also be used to detect and identify pornographic, reactionary, and violent behaviors such as existing social networks and live broadcast platforms. [0003] The current behavior detection methods are divided into two categories from the required supervision information: one is a method based on strong supervision, and its sup...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the defects of the prior art, the purpose of the present invention is to provide a spatio-temporal behavior detection method, which aims to solve the weak supervised spatio-temporal behavior detection method caused by the inability of the prior art to effectively combine executors, specific motion information and temporal recognition behaviors. The problem of poor robustness

Images