Video significance processing method based on spectral analysis

A spectrum analysis and remarkable technology, applied in the field of video analysis and processing system, which can solve the problems of weak versatility, small amount of calculation, and inconvenient application.

Active Publication Date: 2012-12-19
NORTHWESTERN POLYTECHNICAL UNIV
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] There are many traditional video saliency calculation models, but most of these models rely on the specific characteristics of the video scene, the models are complex, the calculation is heavy, and the versatility is not strong
Recently, a video saliency calculation model based on spectrum analysis has also been proposed. T

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video significance processing method based on spectral analysis
  • Video significance processing method based on spectral analysis
  • Video significance processing method based on spectral analysis

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Now in conjunction with embodiment, accompanying drawing, the present invention will be further described:

[0037] The hardware environment used for implementation is: Core dual-core E7500, main frequency 2.93G, 2GB memory, integrated graphics computer, and the running software environment is: Matlab R2011b and Windows XP. We have realized the method that the present invention proposes with Matlab software. The video data is the video of the game between the Lakers and the Spurs on April 12, 2011, in WMV format, 585MB in size, the duration of the entire video is 1 hour, 28 minutes and 26 seconds, the video resolution is 480×320, and the video frame rate is 24fps.

[0038] The present invention is specifically implemented as follows:

[0039] 1 video preprocessing: the following steps are used to extract the key frame of the input video for the input video:

[0040] Step a: Use the optical flow method to calculate the optical flow field component o of each frame x (i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video significance processing method based on spectral analysis. The method comprises the following steps of: extracting a key frame from an input video by utilizing a method for extracting a video key frame according to motion information to acquire a video key frame sequence; extracting a video key frame gray level image sequence and a video key frame motion information characteristic map sequence; calculating Renyi entropy of the video key frame gray level image sequence and the video key frame motion information characteristic map sequence; measuring the distribution of significance points in the air domain significant maps by the Renyi entropy and using a result as a significant value of an air domain significant map; and finally linearly fusing the obvious vale of the video key frame air domain significant value and an obvious value of the time domain so as to acquire an overall obvious value of the video key frame. By the method, the significance information carried by magnitude spectra and phase spectrum in the video key frame field is fully utilized, the calculated amount is small and the effect is prominent; and the distribution of the significance points in the significant maps is measured by the Renyi entropy, and the result is used as the significant value of the significant pattern, so that the problem of overall significance measurement of the significant maps are well solved; and therefore, the method can be applied to video analysis processing systems of various of military use or civil use.

Description

technical field [0001] The invention relates to a video saliency processing method based on frequency spectrum analysis, which can be applied to various military or civilian video analysis and processing systems. Background technique [0002] The development of digital imaging technology has brought us rich video resources, but it also brought a sharp increase in the amount of video data and how to deal with it effectively. Video saliency analysis technology can help people quickly find interesting content from a large amount of visual information, ignore secondary content, and reduce the calculation amount of information processing. It is one of the ways to effectively process massive video data. [0003] There are many traditional video saliency calculation models, but most of these models rely on the specific characteristics of the video scene, the models are complex, the calculation is heavy, and the versatility is not strong. Recently, a video saliency calculation mode...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/20G01R23/16
Inventor 韩军伟赵世杰郭雷程塨
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products