Multi-view-point computing and imaging method based on speckle-structure optical depth camera

Abstract

The invention belongs to the technical field of image processing, provides a multi-view-point computing and imaging method, and aims to acquire accurate and high-precision depth information. According to the technical scheme, the multi-view-point computing and imaging method based on a speckle-structure optical depth camera comprises the following steps of: acquiring a depth map and a color map from human-machine interaction equipment Kinect of Microsoft; detecting the edge of the color map, and expanding gap information until the expanded gap covers the edge, which corresponds to the color map, near the conventional depth map; then performing double-edge filtration estimation on points on the edge of the gap according to depth information and color information; limiting the estimation process by virtue of edge information of the color map; and after the color map and the restored depth map are acquired, converting the depth map into a disparity map, and synthesizing any number of virtual viewpoint maps by a disparity map synthesis method combining a depth image and a color image. The multi-view-point computing and imaging method is mainly applied to image processing.

Description

technical field [0001] The invention belongs to the technical field of image processing. Specifically, it relates to a multi-view computational imaging method based on a speckle structured light depth camera. Background technique [0002] There are many ways for computer vision to obtain the depth of the scene. There are methods such as binocular measurement, a projector with a camera, and other methods such as triangulation calculation methods such as focus depth. The more commonly used method of obtaining depth maps in recent years is to use depth cameras. TOF is one of the depth cameras, which uses the round-trip phase difference of actively emitted infrared light to measure depth. The depth information acquired by the camera is accurate and high-precision, but it has major disadvantages, such as high price and low resolution. Recently, however, Microsoft introduced a new depth camera, which is cheap and facilitates a lot of research that applies depth information. ...

AI Technical Summary

Problems solved by technology

Shortly after Kinect first came out, many methods for repairing Kinect depth maps emerged in the world, but the existing technologies have obvious deficiencies in repairing depth maps, especially for images with transparency and multiple edges, and the repaired depth maps match There is a large deviation when it comes to the color map, and there are many defects at the edges

And some of these methods take too long, some run fast but the final result is not ideal

Images