Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Salient target detection method based on complementary branch network

A target detection and branch network technology, applied in the field of computer vision, can solve problems such as difficult to achieve results, and achieve the effect of ensuring accuracy and sufficient expansion

Active Publication Date: 2021-10-08
NANKAI UNIV
View PDF14 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Usually, the former extracts multi-layer features through the encoder and fuses them with the decoder to obtain saliency maps, while the latter obtains saliency maps by supervising mask labels with the help of edge label priors, although these methods have achieved remarkable results. progress, but some challenges remain
Specifically, these methods often fail to achieve satisfactory results when facing ambiguity, occlusion, illumination, rotation, and salient object detection at different scales.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Salient target detection method based on complementary branch network
  • Salient target detection method based on complementary branch network
  • Salient target detection method based on complementary branch network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0045] as attached figure 1 As shown, the present invention selects ResNet-50 as the backbone network, covering three core components, including label redefinition module, information exchange module and connected flow loss

[0046] Provide a kind of salient object detection method based on complementary branch network, described method step is as follows:

[0047] step one:

[0048] A large amount of heuristic knowledge is embedded in the label, which is crucial to improve the performance of the network.

[0049] To this end, a label redefinition module is proposed to extend sufficient and useful prior knowledge from a given label as an auxiliary label.

[0050] Let b and f denote the foreground pixel and the background pixel respectively, for each foreground pixel, the nearest background pixel can be calculated by the distance conversion function, which can be defined as:

[0051]

[0052] Among them, dist( ) represents the Euclidean distance between pairs of pixels, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a saliency target detection method based on a complementary branch network, and the method comprises the steps: enabling labels of a plurality of images to pass through a label redefinition module, and obtaining expanded diversified saliency labels; processing the extracted features of the backbone network by an information exchange module to obtain saliency features with discrimination capability; and finally, enabling different features to correspond to different labels respectively, and obtaining a saliency result graph through connected flow loss respectively. According to the invention, through the proposed label redefinition module, given labels are sufficiently expanded, useful priori knowledge is used as auxiliary labels, complementary feature information from different branch structures is fused and captured through the proposed information exchange module, and total loss of branch merging is calculated through proposed connected flow loss. Therefore, the optimization of the whole network is supervised, and the accuracy of saliency target detection of a complex scene is ensured.

Description

technical field [0001] The invention belongs to the field of computer vision, in particular to a salient target detection method based on a complementary branch network. Background technique [0002] In recent years, salient object detection has become a research hotspot in the field of computer vision, and its purpose is to obtain the most salient target area in any given image or video. This technology has a wide range of application prospects, such as: image retrieval, video compression, visual tracking, robot navigation, etc. [0003] Traditional salient object detection methods mainly rely on manually extracted limited information, such as color and stripes. At present, due to the development of deep learning, new salient object detection methods emerge in an endless stream. These methods can be roughly divided into two categories, namely aggregation-based methods and edge-based methods. [0004] Usually, the former extracts multi-layer features through the encoder a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/46G06F17/11
CPCG06F17/11
Inventor 方贤王鸿鹏邵秀丽
Owner NANKAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products