Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for detecting image salient target

A detection method, a significant technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problems of lack of clear boundaries between objects and background areas, misclassified pixels, etc.

Active Publication Date: 2020-04-03
DUT ARTIFICIAL INTELLIGENCE INST DALIAN
View PDF3 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Consequently, the results of training saliency models using only image-level labels often lack sharp boundaries between object and background regions, or misclassify pixels near salient object contours.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for detecting image salient target
  • Method for detecting image salient target
  • Method for detecting image salient target

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0108] Step 1: Alternately train CNet and PNet on the Imagenet detetion dataset and the MicrosoftCOCO caption dataset respectively. The loss function of CNet is determined by L c (Equation 6) and L at (Formula 8) consists of two items, and the loss function of PNet is composed of L p (Equation 7) and L at (Equation 8) consists of two terms, L at This enables a network supervised by one label to benefit from the information provided by another label. After 200 iterations, we introduce L on the unlabeled Imagenet classification dataset. ac The loss function (Equation 10) supervises PNet and CNet, L ac The loss function encourages the network to detect salient regions rather than task-specific regions. The significant test results of each module are attached Figure 4 In Cls, Cap, Avg, AT, AC shown.

[0109] Step 2: Use the foreground keywords and background keywords to collect two types of pictures from the Internet, including the salient target picture on the white backg...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for detecting an image saliency target, and belongs to the technical field of image saliency detection. The method comprises the following steps: in a first stage, constructing a classification network CNet and a character sequence generation network PNet to obtain saliency maps from classification and character sequence generation tasks respectively; in a second stage, establishing two complementary training data sets, namely a natural image data set with a noise label and a network image data set, by utilizing CNet and PNet, and alternately training SNet by utilizing the two complementary data sets; and in the third stage, updating the natural image data set and the network image data set by using the prediction result of the SNet, and recursively optimizing the model. In the test stage, only the SNet is used to predict the saliency maps. Experiments show that the method is superior to unsupervised and weakly supervised methods, and still has the goodperformance compared with some supervised methods.

Description

technical field [0001] The invention belongs to the technical field of image saliency detection, and aims to detect a salient object in any image, so as to segment the most salient object area in the image. Background technique [0002] Image saliency detection has attracted widespread attention in recent years. As a preprocessing method, image saliency detection has been widely used in many fields such as image compression, image classification, and image segmentation. Early saliency detection research mainly used manually designed features and heuristic priors to predict salient regions in images, such as using center priors, background priors, etc. In recent years, with the successful application of deep convolutional neural networks (CNNs) in various vision tasks, many deep learning-based saliency detection methods have been proposed. In 2015, the paper "Visual saliency based on multi-scale deep features" published in CVPR proposed to extract multi-scale features from d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/34G06K9/62G06N3/04G06N3/08
CPCG06T7/0002G06T7/194G06N3/084G06N3/08G06T2207/20081G06N3/044G06N3/045
Inventor 卢湖川曾昱张宏爽李建华张立和
Owner DUT ARTIFICIAL INTELLIGENCE INST DALIAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products