Rapid saliency object detection method of multi-scale neural network based on stereo attention control

A neural network and object detection technology, applied in the field of computer vision, can solve the problems of large amount of parameters, high computer complexity, slow speed, etc., to achieve the effect of less parameters, fast speed and small amount of calculation

Inactive Publication Date: 2020-08-28
NANKAI UNIV
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the problems of the existing salient object detection method based on convolutional neural network, such as too high comput

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid saliency object detection method of multi-scale neural network based on stereo attention control
  • Rapid saliency object detection method of multi-scale neural network based on stereo attention control
  • Rapid saliency object detection method of multi-scale neural network based on stereo attention control

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0020] A fast salient object detection method based on a multi-scale neural network controlled by stereo attention, the specific operation of this method is as follows:

[0021] a. Design a multi-scale convolution module with stereo attention control to extract multi-scale convolution features.

[0022] Assume that DSConv3×3 is used to represent the depth separable convolution with a convolution kernel size of 3×3, Conv3×3 is used to represent a normal convolution with a convolution kernel size of 3×3, and Conv1×1 is used to represent a convolution kernel Ordinary convolution with a size of 1×1, using r to represent the expansion rate of the convolution.

[0023] Suppose a convolutional...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid saliency object detection method of a multi-scale neural network based on stereo attention control. The objective of the method is to design a lightweight convolutionalneural network for salient object detection. The method includes: extracting multi-scale convolution features through a multi-branch structure, wherein each branch is a depth separable convolution with different expansion rates; adding the convolution features of all the branches, and calculating an attention graph for each branch by using a three-dimensional attention unit; multiplying the attention map obtained by calculation by the features of each branch, adding the multiplied results of each branch, and adding residual connection to form a multi-scale convolution module controlled by three-dimensional attention; and finally, stacking the multi-scale modules to form a deep convolutional neural network, and performing saliency object detection on a natural image. Experiments show thatcompared with an existing method, the method is higher in speed, fewer in parameters, less in calculated amount and similar in precision.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to a fast salient object detection method based on a multi-scale neural network controlled by stereo attention. Background technique [0002] Salient object detection, also known as saliency detection, is dedicated to detecting the most visually distinctive objects or regions in natural images. Saliency detection techniques have many applications in computer vision, such as image retrieval, image segmentation, object detection, object tracking, scene classification, content-based image editing, etc. Traditional salient object detection methods mainly rely on hand-designed features and prior knowledge, such as image contrast, texture features, and the characteristic that salient objects often appear in the center of the image, but these methods usually lack high-level semantic information. Recently, great advances in deep learning have led to continuous improveme...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/46G06K9/62G06N3/04
CPCG06V10/462G06N3/045G06F18/253
Inventor 刘云张鑫禹程明明
Owner NANKAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products