Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unmanned aerial vehicle video augmented reality implementation method

A technology of augmented reality and implementation method, applied in image data processing, 3D modeling, instruments, etc., can solve the problem that the positioning relationship between video and geographic coordinate system is not established, the POS data of UAV is not fully utilized, and the information layer cannot be directly Multiplexing and other issues to achieve the effect of improving processing efficiency, reducing data processing workload, and improving information fusion capabilities

Pending Publication Date: 2019-06-11
CHINA RAILWAY DESIGN GRP CO LTD
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the video-based augmented reality method mainly uses video processing software, uses computer vision to reconstruct the relative relationship, and then adds information, does not make full use of the POS data of the drone, and does not establish the positioning between the video and the geographic coordinate system relationship, its information fusion ability is low, the information layer cannot be directly reused, and the overall efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle video augmented reality implementation method
  • Unmanned aerial vehicle video augmented reality implementation method
  • Unmanned aerial vehicle video augmented reality implementation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] A method for realizing augmented reality of UAV video based on photogrammetry technology and 3DGIS technology, comprising the following steps:

[0046] S1) A consumer-grade multi-rotor UAV that supports 2K and above resolution camera functions is used. The pitch angle of the camera (relative to the swing angle of the downward view) is 30°-60°. figure 1 Fly at a constant speed on the route shown. Such as figure 2 As shown, the photogrammetry method is used to perform free aerial triangulation processing on the aerial photography data of the calibration field, and obtain accurate camera orientation parameters such as field of view, focal length, and lens distortion. The obtained parameter files are as follows: image 3 shown. Then, the UAV uses the camera to collect strip video, and frames the collected video, and obtains key frame images at a ratio of 1 / 10-1 / 30. In this embodiment, the key frame image is obtained according to the ratio of 1 / 10, such as Figure 4 sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unmanned aerial vehicle video augmented reality implementation method based on a photogrammetry technology and a 3D GIS technology. The method mainly comprises the steps ofvideo frame extraction, camera calibration, aerial triangulation reconstruction, 3D GIS virtual scene establishment, sequence frame image rendering, video synthesis and the like. According to the invention, the POS data of the unmanned aerial vehicle are utilized; the accurate camera track and attitude are recovered by using a space three-adjustment method; A three-dimensional geographic scene isestablished in a 3D GIS system; The method comprises the steps of acquiring a video image, superposing various types of vector data, importing a three-dimensional model, adding a custom character label and a graphic label, realizing a blanking effect by importing a digital surface model, then acquiring a rendered image with the same visual angle as the original video frame by frame, superposing the rendered image with the original video frame by frame, and acquiring a video result containing rich information. According to the method, the processing efficiency and effect are improved, the automation degree can be greatly improved in repeated line inspection application of linear engineering, and an efficient and real technical means is provided for scheme display and on-site inspection.

Description

technical field [0001] The invention belongs to the fields of unmanned aerial vehicle application, computer vision and augmented reality, and in particular relates to a method for realizing augmented reality of unmanned aerial vehicle video based on photogrammetry technology and 3DGIS technology. Background technique [0002] Multi-rotor UAV video aerial photography technology is widely used in the field of construction engineering, mainly used in the information collection of the site during the planning and design phase, and the site inspection during the construction process. Aerial video data without further processing can only be viewed and cannot be integrated with the information system. The video-based augmented reality technology can superimpose text and graphic annotations in the video, and can display design schemes, mark engineering element information, and record problems in aerial videos, which can greatly improve the informatization attributes of aerial video ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T19/00G06T17/05
CPCY02T10/40
Inventor 赵文韩祖杰刘小龙范登科王华宁新稳黄漪张恒宗伟丽王娇
Owner CHINA RAILWAY DESIGN GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com