Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Remote sensing image binocular stereo matching method based on deep network and semantic information

A remote sensing image and stereo matching technology, which is applied in the field of image processing, can solve problems such as being susceptible to illumination changes and seasonal changes, changing viewing angles, remote sensing images cannot achieve satisfactory matching effects, etc., and achieve the effect of improving the accuracy of stereo matching

Active Publication Date: 2019-09-03
XIDIAN UNIV
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Although the existing deep network method can achieve high-precision stereo matching on natural images, due to the characteristics of large image size, small target scale, variable viewing angle, and easy to be affected by illumination changes and seasonal changes in remote sensing images, there are currently The method can not achieve satisfactory matching effect on remote sensing images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote sensing image binocular stereo matching method based on deep network and semantic information
  • Remote sensing image binocular stereo matching method based on deep network and semantic information
  • Remote sensing image binocular stereo matching method based on deep network and semantic information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described below in conjunction with the accompanying drawings.

[0038] refer to figure 1 , the steps to the realization of the present invention are as follows:

[0039] Step 1, collect remote sensing datasets.

[0040]Collect remote sensing images in the public remote sensing dataset US3D, including 4342 pairs of satellite remote sensing images and 4342 corresponding semantic segmentation and stereo matching disparity labels. Each pair of images consists of a left view and a right view of the same scene, and the left and right views have been polarized Correction, where the semantic label divides the image into five categories: ground, building, vegetation, viaduct and water, and the disparity label value is an integer in the interval [-128, 128]. The resolution of each remote sensing image is 1024px×1024px, and the format is a tif t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a remote sensing image binocular stereo matching method based on a deep network and semantic information, and mainly solves the problem of low stereo matching precision of an existing remote sensing image. The method comprises the following steps: 1) collecting US3D data set remote sensing images; 2) using the training semantic segmentation network model to obtain semanticprior of the remote sensing image; 3) carrying out stereo matching on the remote sensing image by using a deep network model; 4) carrying out stereo matching on the remote sensing image by using a traditional SGBM algorithm; 5) fusing the matching results of the step 3) and the step 4) by using semantic prior to obtain a fused parallax image; 6) denoising the fused parallax graph, and 7) correcting the denoised graph in the step 6) by using semantic priori to obtain a binocular stereo matching result. Compared with the prior art, the binocular stereo matching precision of the remote sensing image is improved, and the binocular stereo matching method can be used for three-dimensional space stereo reconstruction of the remote sensing image.

Description

technical field [0001] The invention belongs to the technical field of image processing, and further relates to a binocular stereo matching method, which can be used for three-dimensional spatial reconstruction of remote sensing images. Background technique [0002] With the development of intelligent interpretation technology of remote sensing images, the stereo matching technology of remote sensing images has attracted attention in the field of remote sensing image processing. [0003] Binocular stereo matching is a key part of stereo vision research. Its basic principle is to use two fixed parallel cameras to obtain two pictures from different perspectives of the same scene, called the left view and right view, and use the stereo matching algorithm to find the corresponding Match the parallax of the points, and then obtain the depth information, and realize the reconstruction of three-dimensional space. [0004] Traditional binocular stereo matching methods include local...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/55G06T7/10G06T5/00G06N3/08G06N3/04
CPCG06T7/55G06T7/10G06N3/08G06T2207/10032G06T2207/20021G06T2207/30181G06N3/045G06T5/70
Inventor 焦李成李晓童张若浛陈洁李玲玲冯志玺唐旭马文萍张丹
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products