Intelligent cropping video redirection method based on relative displacement constraint

Abstract

In order to maintain the space-time coherence of a redirected video and the reconstruction quality of important contents of the video, the invention provides an intelligent cropping video redirectionmethod based on relative displacement constraints. The method comprises the following steps: firstly, adaptively fusing a spatial saliency map and a motion history map to obtain an importance map of each frame; obtaining relative displacement between frames through an SIFT matching algorithm and an RANSAC method, and adding the relative displacement between the frames into a time coherence constraint term; carrying out scaling optimization on the video groups after scene detection grouping, and determining an optimal redirection window and a scaling factor of the video groups; and finally, redirecting the video group by using the corresponding redirection window and scaling factor. And if the jump frame exists, performing smoothing processing on the importance degree graph through a feedback mechanism, and performing scaling optimization and redirection again to reduce jitter. Experimental results show that compared with an existing video redirection method, the method not only can obtain better reconstruction quality of important content of the video, but also effectively reduces jitter of the redirection video.

Description

technical field [0001] The invention belongs to the technical field of video processing, and more particularly relates to an intelligent clipping video redirection method based on relative displacement constraints. Background technique [0002] Today, due to the abundance of communication network resources and the rapid and efficient development of compression technology, we can display and play videos on various mobile devices and streaming media terminals of various sizes. For example, TVs, mobile phones, tablet computers, and various outdoor LED displays for displaying images and videos, etc. Therefore, how to adjust the size of the video, so that the video can be played on various mobile devices and streaming media terminals of different sizes, while ensuring the visual experience of the viewers as much as possible. This is a question worth digging into, call it video redirection [1] . [0003] There are three traditional methods for implementing video redirection, na...

AI Technical Summary

Problems solved by technology

However, the current video redirection method fails to maintain good time coherence and important content of the video when dealing with videos with fast and medium motion speeds.

Images