Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-information integration-based frame rate up-conversion motion estimation method and system

A multi-information fusion and motion estimation technology, which is applied to the field of video frame rate up-conversion, can solve the problems of inaccurate estimation of small object motion vectors and large motion vectors, and insufficient robustness of motion vectors, achieving good estimation effect, improving reliability, The effect of improving performance

Active Publication Date: 2016-12-07
SHANGHAI JIAO TONG UNIV
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] However, this frame rate up-conversion motion estimation method is not accurate enough for the estimation of small object motion vectors and large motion vectors.
Not robust enough for complex motion vectors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-information integration-based frame rate up-conversion motion estimation method and system
  • Multi-information integration-based frame rate up-conversion motion estimation method and system
  • Multi-information integration-based frame rate up-conversion motion estimation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0065] Such as figure 1 As shown, it is a flow chart of an embodiment of the frame rate up-conversion motion estimation method of multi-information fusion in the present invention. Specifically, this embodiment includes the following steps:

[0066] 1 Read two consecutive frames of images in the video sequence, and store them as f1 and f2 respectively;

[0067] 2 image downsampling

[0068] For high-definition video (with a resolution of 1920x1080), in order to reduce subsequent computational co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a multi-information integration-based frame rate up-conversion motion estimation method and system. The method comprises the steps of reading a previous frame image and a next frame image; performing down-sampling on the previous frame image and the next frame image; performing optical flow method-based motion estimation on the images experienced down-sampling; performing block match motion estimation on an original image; extracting SIFT characteristics of the previous and the next frame images; calculating a characteristic vector and performing characteristic match, so as to obtain a motion vector of characteristic match; and integrating the block match motion vector, the motion vector of characteristic match, and the motion vector of the optical flow method, and performing motion vector transmission. Compared with traditional block match-based motion estimation algorithm, the method greatly improves the accuracy. Compared with common optical flow estimation algorithm, the method can better maintain the motion vector of a small object and a motion boundary vector.

Description

technical field [0001] The present invention relates to the field of video frame rate up-conversion, in particular to a frame rate up-conversion motion estimation method and system of multi-information fusion. Background technique [0002] As a key parameter of motion video, video frame rate affects the fluency experience of people watching moving objects. In low frame rate video, pixel quality fluctuations between adjacent frames can easily lead to flickering, while motion jittering and animation can easily be observed in sports scenes or sports programs with the same motion direction . High frame rate video can greatly improve these visual experiences, bring better comprehensive visual quality and picture fluency, and become the development direction and important requirement of future video applications. [0003] Frame rate up-conversion FRUC is an important technology of video post-processing. There have been a lot of research work and related achievements in the field...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N5/14
CPCH04N5/145
Inventor 张小云鲁国包文博高志勇陈立
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products