Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A real-time 3D reconstruction method based on UAV

A real-time 3D, unmanned aerial vehicle technology, applied in 3D modeling, image enhancement, image analysis, etc., can solve the problems of non-real-time, time-consuming, difficult matching of feature points, etc., to meet real-time 3D reconstruction and reduce processing Effects of time, surface smoothing

Active Publication Date: 2022-04-12
台州智必安科技有限责任公司 +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] (2) When the deflection angle between pictures is large or the light, season, etc. are different, it will be difficult to match the feature points;
[0008] (3) The feature matching speed is slow, very time-consuming, and not real-time
[0009] Using lidar to quickly scan the scene can efficiently and accurately obtain the information of the three-dimensional points of the scene, but the cost of lidar is high, and it is difficult to popularize and apply
[0010] Based on the reconstruction algorithm of 3D voxel, the method is to initialize a 3D body first, then divide it to obtain smaller cube grids, which are voxels, and then design a cost functional function for each The consistency between a voxel is evaluated, and finally the cost function is minimized to complete the estimation of the three-dimensional surface; the common problem with this method is that the reconstruction result contains more noise

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A real-time 3D reconstruction method based on UAV
  • A real-time 3D reconstruction method based on UAV
  • A real-time 3D reconstruction method based on UAV

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but not to limit the scope of the present invention.

[0072] refer to Figure 1 to Figure 7 , a kind of real-time three-dimensional reconstruction method based on unmanned aerial vehicle of the present invention, comprises the following steps:

[0073] Step 1, obtain the depth data of the depth sensor and obtain the depth map;

[0074] The scene is captured by the binocular camera carried on the drone, and the depth data is obtained through the depth sensor according to the captured picture, and then the depth map of the scene is obtained; the captured image is a grayscale image with a size of 240*320; the depth data uses a xml file, as well as the UAV GPS data and yaw angle data obtained by the Guidence system. figure 2 and image 3...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a real-time three-dimensional reconstruction method based on an unmanned aerial vehicle, comprising the following steps: step 1, collect scene data, obtain depth data through a depth sensor according to the collected scene data, and obtain a depth map; step 2, obtain step 1 Noise preprocessing is performed on the depth image of the noise preprocessing, and the noise preprocessing includes morphological operations and filtering operations; step 3, accelerates the depth image after the noise preprocessing in step 2, and the acceleration processing includes the binary in the depth image after the noise preprocessing. Dimensional points are uniformly sampled; step 4, convert the depth map after accelerated processing in step 3 into a point cloud; step 5, model the point cloud obtained in step 4; step 6, perform noise reprocessing on the result obtained in step 5 , to achieve 3D reconstruction. The invention can carry out real-time three-dimensional reconstruction of the scene, provides the possibility for the subsequent intelligent processing of the drone, and helps to promote the application of the drone.

Description

technical field [0001] The invention belongs to the technical field of unmanned aerial vehicle control, and in particular relates to a real-time three-dimensional reconstruction method based on an unmanned aerial vehicle. Background technique [0002] With the rapid development of information technology and the continuous maturity of equipment technology, there have been unmanned aerial vehicles, referred to as unmanned aerial vehicles (UAV). Because of its characteristics of non-contact, zero casualties, and long-term work, it has been widely used in military and civilian fields. [0003] From a technical point of view, drones can be divided into several categories: unmanned helicopters, unmanned fixed-wing aircraft, unmanned multi-rotor aircraft, unmanned airships, and unmanned paragliders. In the civilian field, UAVs can be used in aerial photography, news reports, environmental monitoring, express delivery, disaster monitoring, traffic patrols and power inspections, etc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T5/00
CPCG06T5/002G06T17/005G06T2207/10028G06T2207/20036G06T2207/20032
Inventor 钱学明徐伟侯兴松邹屹洋
Owner 台州智必安科技有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products