Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and a system for determining binocular scene flow based on semantic segmentation

A technology of semantic segmentation and determination method, applied in the field of scene flow optimization, which can solve the problems of poor performance, blurred scene flow estimation algorithm of moving edges, etc.

Active Publication Date: 2018-12-11
NANCHANG HANGKONG UNIVERSITY
View PDF3 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, even the state-of-the-art scene flow methods still perform poorly near moving edges and object occlusion boundaries, and the problem of moving edge blur and occlusion has always been a difficult problem in scene flow estimation algorithms.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and a system for determining binocular scene flow based on semantic segmentation
  • A method and a system for determining binocular scene flow based on semantic segmentation
  • A method and a system for determining binocular scene flow based on semantic segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0104] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0105] Like scene flow, the field of semantic segmentation is also developing rapidly driven by convolutional neural networks (CNN) and large amounts of labeled data. Since reasoning about depth is often challenging, the present invention uses semantic information to simplify this, improving flow estimation at occluded boundaries. Therefore, the purpose of the present invention is to provide a method and system for determining binocular scene flow based on sem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a system for determining binocular scene flow based on semantic segmentation. Firstly, the scene in binocular image is semantically segmented, and the semantic optical flow is calculated by adding semantic segmentation label information, then the disparity information is calculated by semi-global matching algorithm, and then the motion parameters of countless facet regions are calculated and optimized by combining the semantic optical flow and disparity information fitting. In the process of optimization, the initial scene flow is obtained by superpixel segmentation, and then the motion of the superpixel blocks in the semantic tag is optimized, so the motion of the superpixel blocks in the semantic tag is consistent and the edge information of the moving object is protected well. Semantic information is added into the optical flow information, so that the edge of the object is protected, and the reasoning process of the occlusion problem is greatlysimplified. In addition, the motion inference at the semantic tag level makes the scene flow of pixels on the surface of the same moving object approximately consistent, and ultimately the goal of optimizing the scene flow is achieved.

Description

technical field [0001] The present invention relates to the technical field of scene flow optimization, in particular to a method and system for determining binocular scene flow based on semantic segmentation. Background technique [0002] Scene flow is a three-dimensional motion field formed by the three-dimensional motion of scenes in space. The proposal of scene flow will extend the motion estimation of objects from two-dimensional to three-dimensional, and it is at the core of 3D reconstruction and visual navigation. The common scene flow determination method is the scene flow calculation method based on binocular vision. The principle is to construct a corresponding The motion scene of image pixels in three-dimensional space, that is, scene flow. Scene flow includes the structure and motion characteristics of 3D scenes, and is the core issue in many vision applications, such as video tracking and monitoring, autonomous robot navigation, virtual reality, 3D video compre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/207G06T7/11G06T7/246G06T7/285
CPCG06T7/11G06T7/207G06T7/246G06T7/285G06T2207/10016
Inventor 陈震马龙张聪炫黎明陈昊危水根
Owner NANCHANG HANGKONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products