Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for real-time filling of holes in kinect depth images

A depth image and hole technology, applied in image enhancement, image analysis, image data processing, etc., can solve problems such as restricting Kinect application, high time complexity, and inability to achieve real-time hole filling of Kinect depth image

Active Publication Date: 2017-05-31
SHANGHAI UNIV +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method uses spatial information to fill the holes in the Kinect depth image, and the accuracy of the hole filling is lower than that of the first type of using time domain information to fill the holes in the Kinect depth image, and the time complexity of this method If it is too high, it takes a lot of time to fill, and it is impossible to fill the Kinect depth image in real time, which restricts the application of Kinect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for real-time filling of holes in kinect depth images
  • A method for real-time filling of holes in kinect depth images
  • A method for real-time filling of holes in kinect depth images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] A kind of method of the present invention carries out real-time filling to the hole in the Kinect depth image, as figure 1 As shown, the specific implementation steps are as follows:

[0062] Step 1: Use the Kinect camera to obtain the color image of the shooting scene and the corresponding depth image, use the running-time Gaussian average method to extract the background of the color image to obtain the background image, and then use the background difference method to segment the Kinect color image to obtain the foreground image. Determine the position of the foreground image and the position of the background image, the specific steps are as follows:

[0063] 1.1 Use the Kinect camera to obtain the color image of the shooting scene and its corresponding depth image;

[0064] 1.2 Use the running-time Gaussian averaging method to extract the Kinect color image background to obtain the background image, the expression of which is:

[0065] (1)

[0066] Among them...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed in the invention is a method for filling a cavity in a Kinect depth image in real time. The method comprises the following steps: step 1, obtaining a color image of a shooting scene and a corresponding depth image by using a Kinect camera and determining a foreground image position and a background image position by using an operating-period Gauss average method and a background differencing method; step 2, constructing a deepest image by using a Kinect depth image and filling a cavity in the deepest image; step 3, replacing the pixel of the deepest image with a background pixel of the depth image, thereby realizing cavity filling of the depth image background; and step 4, with the foreground image position obtained by the step 1, marking the cavity existed in the foreground position of the Kinect depth image and filling the marked cavity in real time. According to the invention, the object edge in the depth video with the filled cavity becomes stable; and the no flicker phenomenon occurs in the depth video. Meanwhile, the cavity filling speed in the depth image and the image stability can be improved effectively.

Description

technical field [0001] The invention belongs to the technical field of depth image processing, and more specifically relates to a method for real-time filling of holes in a Kinect depth image. Background technique [0002] Kinect is a Microsoft sensor exhibited by Microsoft in June 2010 (see K. Khoshelham, Sander Oude Elberink.Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications.Sensors 2012, 2012(12), pp. 1437-1454). Kinect 3D stereo camera, which can simultaneously acquire the color image of the shooting scene and the corresponding depth image, because the Kinect camera can easily and cheaply obtain the depth image of the scene in real time, the Kinect camera has been widely used in the fields of 3D scene reconstruction and object segmentation. application. [0003] The capture frequency of Kinect's depth image is 30fps, and there is a large temporal correlation between frames in the actual depth video, which is of great significance for image comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/194G06T11/40
CPCG06T7/11G06T7/50G06T7/90G06T2207/10028
Inventor 安平王健鑫尤志翔张兆扬尚峰范金慧施剑平
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com