Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

First-person immersive unmanned aerial vehicle driving system realized by virtue of virtual reality and binocular vision technology and driving method

A binocular vision and virtual reality technology, applied in the field of drones, can solve problems such as mistakes and the inability of the drone driving system to grasp the real-time flight status in real time, so as to achieve the effect of direct control

Inactive Publication Date: 2016-01-06
HARBIN INST OF TECH
View PDF13 Cites 76 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the problem that the existing UAV driving system cannot grasp the real-time flight status in real time and easily lead to mistakes. The present invention provides a first-person immersive UAV driving realized by means of virtual reality and binocular vision technology. System and Driving Method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • First-person immersive unmanned aerial vehicle driving system realized by virtue of virtual reality and binocular vision technology and driving method
  • First-person immersive unmanned aerial vehicle driving system realized by virtue of virtual reality and binocular vision technology and driving method

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0057] Specific implementation mode one: combine figure 1 with figure 2Describe this embodiment, the first-person immersive UAV driving system realized by means of virtual reality and binocular vision technology described in this embodiment, the system includes a UAV part and a ground station part; the UAV part Including three-axis gimbal stabilizer, binocular camera, UAV image transmission module, UAV data transmission module and UAV control module;

[0058] The binocular camera is used to collect images of the surrounding environment of the drone;

[0059] The UAV image transmission module is used to return the images collected by the binocular camera;

[0060] The drone data transmission module is used to receive the Euler angle of the head relative to the simulated cockpit orientation and the control command of the drone's flight status, and is used to return the flight status information of the drone;

[0061] The UAV controller is used to calculate the received Euler...

specific Embodiment approach 2

[0083] Specific embodiment two: the first-person immersive UAV driving method realized by means of virtual reality and binocular vision technology described in this embodiment, the method includes the embedded program in the UAV and the computer embedded program in the ground station, the described The embedded program in the UAV includes the following steps:

[0084] Steps for collecting images of the surrounding environment of the drone using the binocular camera;

[0085] Steps for returning the image collected by the binocular camera;

[0086] A step for receiving the Euler angle of the head relative to the orientation of the simulated cockpit and the control command of the flight state of the UAV, and for returning the flight state information of the UAV;

[0087] It is used to calculate the Euler angle of the received head relative to the orientation of the simulated cockpit to obtain the action angle command, and is also used to control the flight state of the UAV acco...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A first-person immersive unmanned aerial vehicle driving system realized by virtue of virtual reality and a binocular vision technology and a driving method belong to the technical field of unmanned aerial vehicles and aim at solving the problems that a real-time flying state cannot be mastered through an existing unmanned aerial vehicle driving system, and errors are liable to occur. The driving system and the driving method are characterized in that an unmanned aerial vehicle body carries a binocular camera through an existing tri-axial cradle head stabilizer, an unmanned aerial vehicle image transmission module is equipped for image back transmission, and the tri-axial cradle head stabilizer and the actions of a driver on the ground are synchronized by virtue of a data transmission module and a pair of virtual reality goggles; the driver of the unmanned aerial vehicle on the ground wears the virtual reality goggles and sits in a simulating cabin approximate to a real helicopter driving cabin to feel pictures took by the binocular camera and aircraft flying information, and the flying of the unmanned aerial vehicle is controlled by adopting the data transmission module. The driving system and the driving method are suitable for manipulation of the unmanned aerial vehicle.

Description

technical field [0001] The invention belongs to the technical field of unmanned aerial vehicles. Background technique [0002] Due to the rapid development of drone technology at this stage, especially the civilian drones represented by quadrotors are becoming more and more mature, a large number of drone companies relying on this have emerged, and various research institutions are also actively exploring related new technologies. Although the flight control technology of the multi-axis UAV represented by the four-axis is quite mature, the problems of low efficiency and short battery life due to structural limitations are quite prominent. [0003] Moreover, the control of the UAV still mainly uses the human eye to observe the flight height and attitude of the UAV at a long distance and rely on the remote control to control it. Due to the influence of the distance and the speed of the UAV, it is not very intuitive to grasp the UAV’s position. Real-time flight status, it is e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G01C11/02G05D1/10G05B17/02
CPCG01C11/02G05B17/02G05D1/10
Inventor 崔雅琦苏宇鸿潘光华王惠颖袁帅
Owner HARBIN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com