Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Visual sensor laser radar fused unmanned aerial vehicle positioning and mapping device and method

A vision sensor, lidar technology, applied in the field of vision sensors

Active Publication Date: 2021-02-09
TIANJIN UNIV
View PDF0 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the deficiencies in the prior art, the present invention aims to propose and solve the problem of autonomous positioning and environment map establishment of unmanned aerial vehicles in GPS-denied environments, so as to realize autonomous flight and obstacle avoidance of unmanned aerial vehicles in unknown environments

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual sensor laser radar fused unmanned aerial vehicle positioning and mapping device and method
  • Visual sensor laser radar fused unmanned aerial vehicle positioning and mapping device and method
  • Visual sensor laser radar fused unmanned aerial vehicle positioning and mapping device and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The UAV autonomous positioning and mapping system based on visual radar fusion proposed by the present invention is mainly composed of hardware parts and algorithm parts.

[0075] The hardware part includes binocular camera, 3D lidar, IMU inertial measurement unit, embedded onboard processor and UAV platform. The binocular camera collects the visual information of the surrounding environment, with high measurement frequency and rich information. 3D lidar is mainly used to measure the 3D position information of the surrounding environment of the UAV, with high measurement accuracy and large coverage, and can release the environmental information in the form of 3D point cloud data; The acceleration and angular velocity information of the drone itself; the embedded onboard processor is mainly used for algorithm operation. By processing the data collected by the camera, radar and IMU, it runs the autonomous positioning and mapping algorithm to obtain the drone's own pose an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of visual sensors, laser radars, embedded unmanned aerial vehicles and provides a visual sensor laser radar fused unmanned aerial vehicle positioning and mapping device and method in order to solve the problems of autonomous positioning and environment map establishment of an unmanned aerial vehicle in a GPS denial environment and achieve autonomous flight and obstacle avoidance of the unmanned aerial vehicle in an unknown environment. The invention comprises a binocular camera, a laser radar, an IMU inertial measurement unit, an embedded airborne processor and an unmanned aerial vehicle platform. The binocular camera collects visual information of the surrounding environment; the laser radar is mainly used for measuring three-dimensional position information of the surrounding environment of the unmanned aerial vehicle; the IMU inertial measurement unit is used for measuring acceleration and angular velocity information of the unmanned aerial vehicleat high frequency; the embedded airborne processor is used for algorithm operation, and operates an autonomous positioning and mapping algorithm by processing data acquired by the camera, the radar and the IMU, so as to obtain the pose of the unmanned aerial vehicle and establish an environment map. The invention is mainly applied to unmanned aerial vehicle design and manufacturing occasions.

Description

technical field [0001] The invention belongs to the field of visual sensors, lidar sensors, embedded systems, and unmanned aerial vehicles, and in particular relates to an unmanned aerial vehicle perception system based on the combination of vision and lidar, which solves the problem of GPS (Global Positioning System) rejection The problem of autonomous positioning and environment map establishment of UAV based on visual radar in the restricted environment. Background technique [0002] In recent years, UAV technology is one of the important research hotspots at home and abroad. UAVs use wireless remote control or embedded program control instead of manual tasks to complete various tasks. It requires low advantages and has been widely used in military and civilian fields. Military drones have played an important role in reconnaissance, attack, and electronic countermeasures. Civilian drones are increasingly used in aerial photography, disaster monitoring, line inspection, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06T5/00G06T7/277G01C21/16G01C22/00G01S17/89G01S17/933
CPCG06T7/277G01S17/89G01S17/933G01C21/165G01C22/00G06V20/10G06V10/44G06F18/25G06T5/80Y02T10/40
Inventor 田栢苓戴威张奕恺宗群
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products