Distribution line operation object pose estimation method based on point cloud

A technology for pose estimation and power distribution lines, which is applied in computing, computer components, image enhancement, etc., can solve problems such as difficult operation, low positioning accuracy, and single color of equipment and appliances, so as to ensure real-time performance, increase speed, The effect of strong robustness

Active Publication Date: 2019-09-10
NANJING UNIV OF SCI & TECH
View PDF2 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The positioning accuracy of the target is low, which makes it very difficult to perform operations that require precise positioning, such as replacing lightning arresters and connecting lead wires. Therefore, it is necessary to measure the pose of the work object
However, in the live working site, the environment is more complex, there are many equipment and appliances, and these equipment and appliances have a single color, which is not easy to distinguish from the background environment. These factors make it difficult to measure the target pose
Currently commonly used pose measurement methods, such as the LINEMOD-based method for RGBD images, use stable gradient information and normal vector features to obtain a better pose estimation method, but the robustness to lighting conditions is not strong
When the lighting in the scene changes, the color distribution of the object also changes, which leads to the instability of the model and the failure of the object pose measurement

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distribution line operation object pose estimation method based on point cloud
  • Distribution line operation object pose estimation method based on point cloud
  • Distribution line operation object pose estimation method based on point cloud

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0054] In this embodiment, the operation object to be estimated pose is a lightning arrester, and the pose estimation is performed by the method of the present invention, including the following process:

[0055] 1. The point cloud image of the operation scene including the measurement object is collected by the depth camera, such as image 3 (a) shown.

[0056] 2. Crop the point cloud in the above 1 to reduce the number of point clouds. The point cloud images after clipping the region of interest and adaptive voxel grid filtering are as follows: image 3 (b), 3(c);

[0057] 3. Find the average distance between point clouds, and set the average distance as the confidence interval, and remove the point clouds outside the confidence interval. The processed point cloud image is as follows: image 3 as shown in (d);

[0058] 4. Semantically segment the point cloud after the above 3 processes, separate the job object from the complex environment, and obtain the job object point ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distribution line operation object pose estimation method based on point cloud. The method comprises the following steps of collecting the point cloud data of an operation scene including an object to be measured; cutting the point cloud; setting the average distance between the point clouds as a confidence interval, and then removing the point clouds outside the confidence interval; performing semantic segmentation on the point cloud to obtain the operation object point cloud as a to-be-registered point cloud set P; establishing a three-dimensional model of the operation object with the pose to be estimated, and converting the three-dimensional model into a PCD format of the point cloud so as to construct a point cloud model of the operation object with the poseto be estimated, and taking the point cloud model as a reference point cloud set Q; performing coarse registration on the point cloud set P to be registered and the reference point cloud set Q to enable the reference coordinate systems of the point cloud set P and the reference point cloud set Q to be consistent so as to obtain an initial pose of the operation object; and correcting the initial pose to obtain a final pose. According to the method, the pose measurement result of the operation object can be quickly and accurately obtained in the power distribution line with a more chaotic background, and the method has the higher robustness for illumination change.

Description

technical field [0001] The invention belongs to the field of pose measurement of a working object of a live working robot, in particular to a method for estimating the pose of a working object of a power distribution line based on a point cloud. Background technique [0002] With the vigorous development of robot technology, the status of robots in modern production and life is becoming more and more important. Introducing live working robots into the power industry to replace manual power maintenance and repair work can effectively avoid casualties during live work, and can greatly improve the operating efficiency of power maintenance and repair. [0003] At present, most of the live working robots developed at home and abroad for maintenance of power distribution lines require operators to remotely operate the robotic arm to perform the task at high altitude or with the help of video surveillance. The positioning accuracy of the target is low, which makes it very difficul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/70G06K9/34B25J9/16
CPCG06T7/70B25J9/1697G06T2207/10028G06V10/267Y04S10/50
Inventor 肖潇郭毓蔡梁吴钧浩张冕郭飞
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products