Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for realizing virtual reality by using unmanned aerial vehicle based on computer vision

A technology of unmanned aerial vehicles and computer vision, which is applied to the input/output of user/computer interaction, computer components, calculations, etc. It can solve the problems of difficult control of unmanned aerial vehicles and the inability to observe unmanned aerial vehicles in real time, so as to achieve improved control Sexuality and fun, improve user experience, and facilitate detection

Inactive Publication Date: 2017-01-18
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV +1
View PDF10 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the deficiencies of the prior art, the present invention provides a computer vision-based method and device for realizing virtual reality by using an unmanned aerial vehicle, which solves the difficulty in controlling the unmanned aerial vehicle in the prior art and the inability to observe the onboard camera of the unmanned aerial vehicle in real time Problems with captured video information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing virtual reality by using unmanned aerial vehicle based on computer vision
  • Method and device for realizing virtual reality by using unmanned aerial vehicle based on computer vision
  • Method and device for realizing virtual reality by using unmanned aerial vehicle based on computer vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be further described in detail below in combination with specific embodiments and with reference to the accompanying drawings. It should be emphasized that the following description is only exemplary and not intended to limit the scope of the invention and its application.

[0031] Such as figure 1 Shown, a kind of method based on computer vision utilizing unmanned aerial vehicle to realize virtual reality, comprises the following steps:

[0032] S1. The gesture information collection and processing device collects the gesture information of the controller to control multiple unmanned aerial vehicles in real time.

[0033] Specifically, the gesture information collection and processing device is used to collect the depth information of the controller's gestures, and the obtained depth information can estimate the distance information between each calibration point of the controller's hand and the collection device. Gesture information is obt...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for realizing virtual reality by using an unmanned aerial vehicle based on computer vision. The method comprises the following steps: acquiring and operating by using a variety of sensors to obtain real-time gesture information of a controller, and feeding a gesture control signal of the controller back into a plurality of flight attitudes of the unmanned aerial vehicle in real time to achieve one-to-one correspondence between the attitudes of the unmanned aerial vehicle and the gesture of the controller, so as to control angles and directions of a plurality of airborne cameras of the unmanned aerial vehicle to obtain a visual image expected by the controller; shooting real-time video information of the surrounding environment and returning the real-time video information to virtual reality equipment by the airborne cameras of the unmanned aerial vehicle; receiving the real-time video information of the surrounding environment, shot by the airborne cameras of the unmanned aerial vehicle, by the virtual reality equipment, performing 3D processing, rendering, and displaying on a display device in real time. Through the method and the device, a user experience is improved, a user can use the unmanned aerial vehicle for special-purpose detection conveniently, and the controllability and the funniness of the unmanned aerial vehicle are enhanced.

Description

technical field [0001] The invention relates to the field of virtual reality interaction of unmanned aerial vehicles, in particular to a method for adjusting the flight attitude of multiple unmanned aerial vehicles and taking pictures of multiple aerial vehicles according to the change of the gesture information of the controller at the position in front of the depth of field camera equipped on the virtual reality device. A method and a device for displaying received real-time video information on a display screen of a virtual reality device after 3D processing and rendering by an image processing device. Background technique [0002] With the rapid development of unmanned aerial vehicle technology, more and more unmanned aerial vehicles have entered people's life scenes. By setting up cameras on unmanned aerial vehicles, you can obtain rich and colorful aerial video information. How to better watch aerial photography Video information, in order to be more convenient to oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00H04N13/00H04N13/04G05D1/10
CPCG06F3/011G05D1/101G06F3/017G06F2203/012G06T19/006H04N13/122H04N13/332
Inventor 金欣魏乐业戴琼海张新
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com