Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device used for marking object

A technology of objects and target objects, applied in the direction of instruments, character and pattern recognition, computer components, etc., can solve the problems of complex and changeable scenes, easy to ignore the situation of flanking scenes, and inability to effectively make evasive responses, so as to achieve the purpose of assisting driving Effect

Inactive Publication Date: 2017-01-18
四川天辰智创科技有限公司
View PDF8 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, under the existing technology, the driver cannot monitor the surrounding environment of the UAV in real time in all directions, and at the same time has no energy to respond to the situation in all directions. Therefore, there are three major defects in the existing technology:
[0004] 1. Unable to effectively avoid dynamic obstacles:
[0005] The real scene is complex and changeable. When controlling the UAV remotely, it is often easy to ignore the situation on the flanks when changing the driving direction.
[0006] 2. Unable to avoid dynamic obstacles such as flying birds suddenly appearing in the air;
[0007] The real scene is complex and changeable. Even if the drone is controlled remotely, even if it is traveling in an open airspace, the operator cannot effectively respond to sudden birds and other objects because the operator cannot perceive them in advance.
[0008] 3. Unable to effectively avoid static obstacles such as complex buildings;
[0009] It is difficult for a UAV to make a good assessment of the environment and surrounding objects after passing through complex building structures or jungles. Therefore, even if it is operated manually, it is difficult to effectively avoid obstacles

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device used for marking object
  • Method and device used for marking object
  • Method and device used for marking object

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0051] Please refer to image 3 , image 3 It is a flow chart of the method for marking objects provided by the first embodiment of the present invention, and the method is applied to the UAV 100 and the auxiliary driving device 200 connected to each other through communication. The specific flow of the method for labeling objects will be described in detail below.

[0052] Step S111 , the UAV 100 acquires a panoramic image, and sends the panoramic image to the driving assistance device 200 .

[0053] In this embodiment, the UAV 100 can collect panoramic images around the UAV 100 by setting two panoramic optical cameras. Specifically, the installation positions of the two panoramic optical cameras may be opposite, so as to realize image collection without dead angles. In this embodiment, preferably, one of the panoramic optical cameras is set on one side of the propeller of the UAV 100 for capturing images of the sky, and the other panoramic optical camera is set on the bel...

no. 2 example

[0068] Please refer to Figure 4 , Figure 4 It is a flow chart of the method for marking objects provided by the second embodiment of the present invention, and the method is applied to the auxiliary driving device 200 connected to the UAV 100 in communication. The specific flow of the method for labeling objects will be described in detail below.

[0069] Step S121 , receiving the panoramic image captured by the UAV 100 .

[0070] Specifically, after the UAV 100 obtains the panoramic image through the panoramic optical camera, it transmits the data of the panoramic image to the driving assistance device 200 .

[0071] Step S122, performing visual scene analysis on the panoramic image to obtain scenes and objects under the panoramic image.

[0072] In this embodiment, the driving assistance device 200 uses a neural network algorithm of deep learning to perform visual scene analysis on the panoramic image to obtain scenes and objects under the panoramic image.

[0073] Whe...

no. 3 example

[0080] Please refer to Figure 5 , Figure 5 An apparatus 220 for marking objects is provided according to the third embodiment of the present invention, and the apparatus is applied to the driving assistance device 200 communicatively connected with the UAV 100 . The device 220 includes: a receiving module 2201 , a visual scene analysis module 2202 , an object recognition module 2203 and a display module 2204 .

[0081] The receiving module 2201 is used for executing step S121 in the second embodiment, for receiving the panoramic image acquired by the UAV 100 .

[0082] The visual scene analysis module 2202 is used for executing step S122 in the second embodiment, for performing visual scene analysis on the panoramic image to obtain scenes and objects under the panoramic image. The visual scene analysis module 2202 uses a neural network algorithm based on deep learning to analyze the received panoramic image to obtain scenes and objects under the panoramic image.

[0083] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device used for marking an object. The method comprises steps that a panorama image is acquired by an unmanned plane, and the panorama image is sent to auxiliary driving equipment; the panorama image is received by the auxiliary driving equipment, visual scene analysis on the panorama image is carried out, and a scene and the object of the panorama image are acquired; target identification of the object under the scene corresponding to the panorama image is carried out through the auxiliary driving equipment; when a target object exists, an image frame including the target object is displayed by the auxiliary driving equipment; and the object in the image frame is marked. Through the method, the panorama image can be acquired in real time, all visual fields around the unmanned plane are guaranteed to monitor, the target object of the scene of the unmanned plane is further marked, reference is provided for auxiliary driving of the unmanned plane, and an operator is made to easily avoid the target object.

Description

technical field [0001] The invention relates to the field of assisted driving of unmanned aerial vehicles, in particular, to a method and device for marking objects. Background technique [0002] In the prior art, UAV assisted driving mainly obtains the data information required for UAV driving through gyroscope, GPS, airspeed head and other sensors, so that the assisted driver can control the UAV through the above data information. Operation, so as to ensure the stability of the drone's flight attitude, and realize the transfer of the spatial position and other functions. [0003] However, under the existing technology, the driver cannot monitor the surrounding environment of the UAV in real time in all directions, and at the same time has no energy to respond to the situation in all directions. Therefore, there are three major defects in the existing technology: [0004] 1. Unable to effectively avoid dynamic obstacles: [0005] The real scene is complex and changeable. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V20/20
Inventor 滕龙孙晓刚任骥张弟
Owner 四川天辰智创科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products