Intelligent cropping video redirection method based on relative displacement constraint

A technology of relative displacement and redirection, which is applied in the field of video processing, can solve the problem that the redirected video fails to maintain good time continuity, and achieve the effect of reducing jitter

Active Publication Date: 2020-06-30
GUANGXI UNIV
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current video redirection method fails to maintain good time coherence an...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent cropping video redirection method based on relative displacement constraint
  • Intelligent cropping video redirection method based on relative displacement constraint
  • Intelligent cropping video redirection method based on relative displacement constraint

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0023] Traditional video redirection methods do not consider the diversity of video content, resulting in deformation, distortion, incomplete important content and other problems in the redirected video. In order to enhance the effect and user experience of redirected videos, a content-based redirection method emerges as the times require. At present, there are four main types of content-based ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

In order to maintain the space-time coherence of a redirected video and the reconstruction quality of important contents of the video, the invention provides an intelligent cropping video redirectionmethod based on relative displacement constraints. The method comprises the following steps: firstly, adaptively fusing a spatial saliency map and a motion history map to obtain an importance map of each frame; obtaining relative displacement between frames through an SIFT matching algorithm and an RANSAC method, and adding the relative displacement between the frames into a time coherence constraint term; carrying out scaling optimization on the video groups after scene detection grouping, and determining an optimal redirection window and a scaling factor of the video groups; and finally, redirecting the video group by using the corresponding redirection window and scaling factor. And if the jump frame exists, performing smoothing processing on the importance degree graph through a feedback mechanism, and performing scaling optimization and redirection again to reduce jitter. Experimental results show that compared with an existing video redirection method, the method not only can obtain better reconstruction quality of important content of the video, but also effectively reduces jitter of the redirection video.

Description

technical field [0001] The invention belongs to the technical field of video processing, and more particularly relates to an intelligent clipping video redirection method based on relative displacement constraints. Background technique [0002] Today, due to the abundance of communication network resources and the rapid and efficient development of compression technology, we can display and play videos on various mobile devices and streaming media terminals of various sizes. For example, TVs, mobile phones, tablet computers, and various outdoor LED displays for displaying images and videos, etc. Therefore, how to adjust the size of the video, so that the video can be played on various mobile devices and streaming media terminals of different sizes, while ensuring the visual experience of the viewers as much as possible. This is a question worth digging into, call it video redirection [1] . [0003] There are three traditional methods for implementing video redirection, na...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V20/46G06V10/462G06F18/22
Inventor 唐振华唐雨霞王帅梁雪霞覃团发
Owner GUANGXI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products