Deep and repaid frame inserting method for three-dimensional video

A three-dimensional, frame-based technology, applied in the field of video processing, can solve problems such as inaccuracy, large time overhead, and increased motion estimation time overhead

Active Publication Date: 2012-10-31
TSINGHUA UNIV
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional frame filling algorithm based on block motion estimation has some obvious defects: 1) The time overhead of motion estimation is very large, resulting in low frame interpolation efficiency; 2) Motion estimation directly using depth video is not accurate enough
However, the use of color video for motion estimation further increases the time overhead of motion estimation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep and repaid frame inserting method for three-dimensional video
  • Deep and repaid frame inserting method for three-dimensional video
  • Deep and repaid frame inserting method for three-dimensional video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The deep fast frame interpolation method for three-dimensional stereoscopic video proposed by the present invention, its flow chart is as follows figure 1 shown, including the following steps:

[0050] (1) Set the encoding structure of the color video in a 3D stereoscopic video, so that the depth video frame in the collected 3D stereoscopic video corresponds to the I frame and P frame of the color video in the collected 3D stereoscopic video, so that the to-be-inserted The depth video frame in the 3D stereoscopic video is corresponding to the B frame of the color video in the collected 3D stereoscopic video, and the depth value of each pixel of the depth video frame to be inserted is initialized to be -1;

[0051] For example, one frame is captured for every three depth video frames in the 3D stereoscopic video, and the other two depth video frames need to be obtained through frame interpolation, so under the H.264 / AVC encoding standard, the Color video is encoded usin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a deep and rapid frame inserting method for three-dimensional video, which belongs to the field of video processing. The method comprises the following steps: firstly selecting the decoding structure of color video according to the frame rate of deep video, so as to ensure that deep frame to be inserted corresponds to the B frame of the color video, directly extracting the motion vector of the color video at a decoding terminal, which is used for finding out a reference macro block corresponding to a deep macro block to be inserted, and adopting an improved deep macro block filling algorithm to fill the deep macro block to be inserted. The method has the advantages that the color video is utilized for motion estimation, the improved filling algorithm is also utilized, the quality of deep video frame inserting is greatly improved, the recovered deep video has a clearer object edge and a better local smoothness property, and a better three-dimensional visual effect is obtained. The method directly reads the motion information of the color video, thereby canceling the step of motion estimation during frame inserting, greatly improving the frame inserting efficiency, and being more applicable to the practical industrial application.

Description

technical field [0001] The invention relates to a deep and fast frame interpolation method for three-dimensional stereoscopic video, belonging to the technical field of video processing. Background technique [0002] Three-dimensional stereoscopic video has replaced traditional two-dimensional color TV in many applications, because it can bring users a brand-new viewing experience: users can obtain a more realistic three-dimensional scene experience and feeling, and can freely choose the viewing point of view and watch it at any time Switch between different viewpoints. Compared with traditional 2D video, 3D stereoscopic video has great advantages in visual effect and user interaction, making 3D stereoscopic video a research hotspot, and has been rapidly developed and popularized. [0003] At present, a commonly used 3D stereoscopic video display technology is "video + depth" technology: one channel of color video is used to express texture information, and one channel of c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N13/00H04N13/02
Inventor 孙立峰李彦洁
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products