Image calibration method based on RGBD depth camera device

An image calibration and depth camera technology, applied in the field of image processing, can solve the problems of low practicability, need for many auxiliary devices, small viewing angle, etc.

Active Publication Date: 2020-02-25
上海脉沃医疗科技有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The problem with using RGBD camera devices for gait acquisition and analysis is that a single RGBD camera device has a limited field of view due to its small viewing angle. During the 3D reconstruction process, it is necessary to move the camera to scan from multiple angles to reconstruct a complete human body or scene model. Synchronization of multiple RGBD cameras Acquisition becomes the best 3D reconstruction technology solution
However, the 3D point cloud collected by multiple RGBD cameras needs to be registered and fused before 3D reconstruction can be performed. The registration process of 3D point cloud requires a large amount of calculation and takes a long time. The calculation time will be further extended as the accuracy requirements increase, and The registration effect depends on the initialization parameters of the registration algorithm
Therefore, many researchers first use the color camera device in the RGBD camera device to calibrate the camera device, and then further calibrate the depth information (3D point cloud) based on the calibration results of the color camera device. This method can significantly reduce the calculation amount of point cloud registration and Calculation time, but this method needs to place camera calibration aids during the registration process, such as T-frame or black and white checkerboard, so that each camera can completely capture multiple frames of camera calibration aids from different angles
This method is complicated to operate and requires many auxiliary devices, so the practicability is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image calibration method based on RGBD depth camera device
  • Image calibration method based on RGBD depth camera device
  • Image calibration method based on RGBD depth camera device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0045] In an embodiment of the present invention, two RGBD depth camera devices are used for image acquisition. In this embodiment, the method for calibrating the images simultaneously collected by the two RGBD depth camera devices is as follows: figure 2 Shown, including:

[0046] S1: Collect images taken by two RGBD depth camera devices, the images include color images and depth images, the left camera device is used as the target camera device, the original point (X1, Y1, Z1) and color images are collected, and the right camera is taken The device is used as a calibrated camera device to collect original points (X2, Y2, Z2) and color images.

[0047] S2: Select the color pictures taken by the target camera device and the calibration camera device at the same time, use the (Oriented Fase and Rotated BRIEF) algorithm in the OpenCV computational vision library to extract the feature points of the two pictures respectively, and use the GMS algorithm to perform one One pairing work...

Embodiment 3

[0075] In a specific embodiment of the present invention, in order to increase the calculation speed, during the ICP registration process, three levels of down-sampling can be performed on the initial point cloud and the target point cloud to obtain four sets of corresponding point clouds, which are respectively the initial scale points Cloud (512*424), quarter-scale point cloud (256*212), one-sixteenth-scale point cloud (128*106), and sixty-fourth-scale point cloud (64*53). Then, the corresponding point cloud of one-64th scale is registered to obtain a rough registration transformation matrix, and this transformation is applied to the one-sixteenth of the initial point cloud. Then, repeat the previous step for the corresponding point cloud of the one-sixteenth scale. The same applies to the point cloud of the quarter-scale and the initial point cloud, and finally an accurate transformation matrix is ​​obtained. Through the above improvements, the present invention significantl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image calibration method based on RGBD depth camera devices, which is used for gait acquisition and analysis, and comprises the following steps: acquiring images of a humanbody by using an imaging device, selecting feature points corresponding to the images acquired by the RGBD depth camera devices at the same moment by using a GMS algorithm, and pairing the feature points; fitting a rotation and translation matrix by utilizing the paired feature points and a general analysis method; and performing rotational translation calculation on all points acquired by the target camera device by using the rotational translation matrix, and performing registration by using an ICP algorithm to obtain a fine rotational translation matrix. By means of the method, the situation that gait information cannot be completely and accurately collected due to the factors such as the side body of a subject and the arrangement position of the camera device can be avoided, and compared with the prior art, the method can meet the real-time requirement, can guarantee precision, and is high in efficiency and short in consumed time.

Description

Technical field [0001] The present invention relates to the field of image processing, and more specifically, to an image calibration method based on an RGBD depth camera device, a computer storage medium, and computer equipment. Background technique [0002] Gait is a periodic phenomenon that describes the characteristics of human or animal walking, and each cycle can be divided into multiple parts for analysis. Gait analysis is a process of using the concept of biomechanics to calculate gait time, space, dynamics and other gait parameters through the gait data collected by the human body during walking, and to research and analyze gait characteristics. With the development of computer technology and human biomechanics, in recent years, gait analysis has received more and more attention, both in clinical and scientific research, such as movement recognition, rehabilitation evaluation, disease monitoring and diagnosis, and artificial The design of joints and assistive devices ha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/33G06T7/35
CPCG06T7/33G06T7/35G06T2207/10028
Inventor 马安邦程龙李巍万子强
Owner 上海脉沃医疗科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products