Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Semantic segmentation method and system for RGB-D image

A semantic segmentation and image technology, applied in the field of deep learning, can solve the problems of low accuracy of RGB-D image semantic segmentation, failure to fully utilize color information and depth information effectively, and achieve the effect of improving the accuracy.

Active Publication Date: 2019-10-01
HANGZHOU WEIMING XINKE TECH CO LTD +1
View PDF2 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the existing methods fail to make full use of color information and depth information, and at the same time fail to effectively mine the contextual semantic information of the image, resulting in a low accuracy rate for RGB-D image semantic segmentation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic segmentation method and system for RGB-D image
  • Semantic segmentation method and system for RGB-D image
  • Semantic segmentation method and system for RGB-D image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0050] According to the embodiment of the present application, a semantic segmentation method of RGB-D image is proposed, such as figure 1 shown, including:

[0051] S101, extracting RGB encoding features and depth encoding features in multiple stages of RGB-D images;

[0052]S102, input the RGB coding features and depth coding features of each stage in the multiple stages into the attention model, and obtain the multimodal fusion...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a semantic segmentation method and system for an RGB-D image. The semantic segmentation method comprises the steps: extracting RGB coding features and depth coding features ofan RGB-D image in multiple stages; inputting the RGB coding features and the depth coding features of each stage in the plurality of stages into an attention model to obtain each multi-mode fusion feature corresponding to each stage; extracting context semantic information of the multi-modal fusion features in the fifth stage by using a long short-term memory network; splicing the multi-modal fusion features and the context semantic information in the fifth stage to obtain context semantic features; and performing up-sampling on the context semantic features, and fusing the context semantic features with the multi-modal fusion features of the corresponding stage by using a jump connection mode to obtain a semantic segmentation map and a semantic segmentation model. By extracting RGB codingfeatures and depth coding features of the RGB-D image in multiple stages, the semantic segmentation method effectively utilizes color information and depth information of the RGB-D image, and effectively mines context semantic information of the image by using a long short-term memory network, so that the semantic segmentation accuracy of the RGB-D image is improved.

Description

technical field [0001] The present application relates to the field of deep learning technology, in particular to a method and system for semantic segmentation of RGB-D images. Background technique [0002] Semantic segmentation is particularly important in the application of computer intelligent image processing. The process of semantic segmentation is the process of identifying the category of each pixel in the image according to the visual content of the image. It can be understood that the pixel values ​​of the pixels belonging to the same category in an image are the same. As the basis of image scene understanding, semantic segmentation has important Research value and broad application prospects, such as UAV navigation and automatic driving, etc. [0003] With the rise of deep convolutional neural networks, deep convolutional networks have become the most effective method for extracting image features. In 2015, the full convolutional network opened up a new model of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/62G06N3/04
CPCG06N3/049G06V10/40G06V10/56G06F18/253
Inventor 孙启超李宏
Owner HANGZHOU WEIMING XINKE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products