Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for converting high-resolution monocular 2D video into binocular 3D video

A high-resolution, video technology used in image analysis, graphic-to-image conversion, instrumentation, etc.

Active Publication Date: 2021-03-23
SOUTHEAST UNIV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] The present invention solves the above-mentioned problems and difficulties, and provides a method for converting high-resolution monocular 2D video to binocular 3D video. This method can process any high-resolution 2D video without camera parameters and other Under the premise of information, without manual operation, it can automatically convert the input monocular 2D video to 3D video, and maintain the original resolution and quality effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for converting high-resolution monocular 2D video into binocular 3D video
  • Method for converting high-resolution monocular 2D video into binocular 3D video
  • Method for converting high-resolution monocular 2D video into binocular 3D video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0083] Step 1: Extract the left and right frames from the left and right videos of the 3D movie, and scale the resolution to 512*288. Then, calculate the texture color complexity C and brightness index L of the image, for and Y are in Image pairs with rich texture and color information and appropriate brightness are preserved and organized. and are the average texture complexity and brightness, respectively, which depend on the mean of the texture complexity and brightness of all extracted image pairs. h and w are image dimensions, is the color component of the pixel point at the (i, j) coordinate R channel, and the brightness Y is to calculate the brightness channel component in the YUV color space. The calculation rules are as follows:

[0084]

[0085]

[0086] Y=0.299R+0.587G+0.114B

[0087] The SGBM algorithm is used to perform binocular stereo matching on image pairs. As a global stereo matching algorithm, the SGBM algorithm can calculate its disparity ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for converting a high-resolution monocular 2D video into a binocular 3D video, and the method comprises the steps: training a convolution network of a U-shaped structure at a depth information extraction stage through employing a conventional 3D film as a source data set, obtaining a network model with excellent performances, and carrying out the frame-by-frame depth estimation of the 2D video; and performing edge-preserving smooth optimization processing on the depth map by using a small neural network. In the viewpoint synthesis stage, a camera-parameter-freeviewpoint synthesis algorithm based on a depth map is provided, and left and right virtual viewpoints are synthesized by adopting a symmetric strategy of rendering from the middle to two sides. And finally, in an image restoration stage, an image restoration algorithm based on block matching in combination with time domain information is proposed, and crack holes in left and right viewpoints arefilled and restored. According to the invention, 2D-to-3D video conversion can be carried out on an original 2D video without any related parameter information, so that not only can a high-resolutionpicture be effectively processed, but also the conversion effect is good and the conversion speed is high.

Description

technical field [0001] The invention relates to a method for converting high-resolution monocular 2D video to binocular 3D video, and belongs to the fields of image processing, computer vision and computer graphics. Background technique [0002] In recent years, multimedia-related technologies and hardware devices have developed rapidly, and various 3D and VR devices have been launched on the market, such as VR glasses, 3D screen mobile phones, and 3D displays. At the same time, users' entertainment needs for watching 3D videos are also increasing. However, ordinary mobile devices with a shooting function can only shoot ordinary monocular 2D videos, and there is currently a lack of technology for converting 2D videos into 3D videos on the market. Whether it is a 3D movie screen, VR glasses, or a 3D screen mobile phone and display, it needs to be supported by a variety of binocular 3D video resources to provide users with a 3D video viewing experience with stereoscopic, immer...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N13/261H04N13/268G06N3/04G06K9/62G06T3/40G06T7/593
CPCH04N13/261H04N13/268G06T3/4076G06T7/593G06N3/045G06F18/214Y02T10/40
Inventor 姚莉李林鑫杨俊宴吴含前
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com