Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

IMU-based SLAM motion blur pose tracking algorithm

A tracking algorithm and motion blur technology, applied in computing, image data processing, instruments, etc., can solve the problems of camera positioning and tracking in lost and motion blur segments

Active Publication Date: 2018-10-12
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] To sum up, how to provide an IMU-based SLAM motion blur pose tracking algorithm to solve the problem that SLAM cannot perform camera positioning and tracking loss on the motion blur segment in the image sequence has become the common expectation of technicians in the industry. one of the problems solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • IMU-based SLAM motion blur pose tracking algorithm
  • IMU-based SLAM motion blur pose tracking algorithm
  • IMU-based SLAM motion blur pose tracking algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] like figure 1 As shown, the present invention discloses an IMU-based SLAM motion blur pose tracking algorithm, which is improved based on the ORB-SLAM2 framework, and uses the measured values ​​of the IMU to track the camera pose.

[0065] Specifically, it includes the following steps:

[0066] S1. Perform ORB feature extraction on the input image sequence, judge whether the image sequence belongs to a normal image or a motion-blurred image according to the number of extracted feature points, and choose one to perform step S2 or S3 according to the judgment result;

[0067] S2. If the judgment result is a normal image, use the uniform motion model to estimate the initial pose of the camera, and then perform bundle adjustment of the motion parameters;

[0068] S3. If the judgment result is a motion blur image, use the IMU motion equation to obtain the estimated pose, then use the extended Kalman filter to obtain the optimized pose, and finally combine the estimated pose...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an IMU-based SLAM motion blur pose tracking algorithm. The algorithm comprises the following steps of S1, performing ORB feature extraction on an input image sequence, judgingthe type of the image sequence according to the quantity of feature points, and according to a judgment result, alternatively performing the step S2 or S3; S2, if the image sequence is a normal image,estimating an initial pose of a camera by utilizing a uniform motion model, and executing bundle adjustment of motion parameters; and S3, if the image sequence is a motion blur image, obtaining an estimated pose by utilizing an IMU motion equation, obtaining an optimized pose by utilizing an extended Kalman filter, and combining the estimated pose with the optimized pose to obtain a final pose ofthe camera. For the problem of loss due to the fact that SLAM cannot perform camera locating and tracking on a motion blur section in the image sequence, the camera pose is calculated and optimized in combination with and by utilizing a kinematical equation of an inertial measurement unit and the extended Kalman filter, so that the SLAM can obtain continuous and reliable camera pose locating andtracking.

Description

technical field [0001] The invention relates to a tracking algorithm, in particular to an IMU-based SLAM motion fuzzy pose tracking algorithm, belonging to the fields of computer vision and robots. Background technique [0002] Simultaneous localization and mapping (SLAM) is a research hotspot in the field of computer vision and robotics in recent years. SLAM technology can construct and update maps in unknown environments, and track and locate in real time. Early SLAM methods used filtering to solve problems. Davinson et al. proposed a real-time single-camera MonoSLAM method, which uses extended Kalman filtering as the backend to track very sparse feature points at the front end. Eade et al. proposed a scale-variable monocular SLAM method, which uses particle filtering and top-down search to draw a large number of landmarks in real time. Most of these methods use filters to process image frames to correlate and estimate the positions of map points and camera poses. Since ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/246G06T7/277G06T7/73
CPCG06T7/246G06T7/277G06T7/73G06T2207/10016G06T2207/20076G06T2207/20024
Inventor 霍智勇陈钊
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products