Multi-label image classification method based on direct push type semi-supervised deep learning

A technology of deep learning and classification methods, applied in neural learning methods, character and pattern recognition, instruments, etc., to achieve good robustness and reduce labeling costs

Pending Publication Date: 2022-08-09
XIAN UNIV OF TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In summary, for multi-label image classification tasks, the current semi-supervised learning methods still have certain limitations and deficiencies.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-label image classification method based on direct push type semi-supervised deep learning
  • Multi-label image classification method based on direct push type semi-supervised deep learning
  • Multi-label image classification method based on direct push type semi-supervised deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0117] Based on two currently commonly used deep convolutional neural network models, AlexNet and GoogLeNet, experimental evaluations are performed on two multi-label image classification datasets, Pascal VOC 2007 and MIR Flickr 25K, to fully verify the effectiveness of the method of the present invention.

[0118] PascalVOC2007 dataset: This dataset contains 9963 images in 20 classes. Each image has 1 to 5 class labels, with an average of 1.8 class labels. The official standard data division and evaluation indicators are used, that is, 5011 images in the training set and 4952 images in the test set, and the evaluation indicator is mAP (mean of Average Precision). The mAP value ranges from 0 to 1. The larger the mAP value, the better the classification performance.

[0119] MIR Flickr 25K dataset: This dataset contains 25000 images, which are annotated into 24 classes. For 14 of them, image sets with more prominent corresponding class instances are selected as a new class. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-label image classification method based on direct push type semi-supervised deep learning, and the method specifically comprises the steps: 1) preparing a multi-label image training sample set, and dividing the training sample set into a labeled training sample set and an unlabeled training sample set; 2) constructing a class symbiosis relation graph; 3) building a network model according to the class symbiosis relation graph; 4) constructing a cross-correlation entropy classification loss function with confidence; 5) constructing a classification probability constraint function with confidence; 6) constructing a category-feature correlation objective function with confidence; 7) constructing a total objective function; (8) training the network model built in the step (3) according to the total objective function constructed in the step (7) in combination with a direct push type semi-supervised learning principle; and 9) inputting a to-be-classified multi-label image into the network model trained in the step 8), and obtaining a prediction category of the image in a classification layer. According to the method, the feature vectors with higher category correlation can be learned.

Description

technical field [0001] The invention belongs to the technical field of computer vision multi-label image classification, in particular to a multi-label image classification method based on transductive semi-supervised deep learning. Background technique [0002] Multi-label image refers to an object with multiple class labels in an image, and multi-label image classification refers to assigning multiple class labels related to each image from a predefined set of class labels. Multi-label image classification has a wide range of application requirements. The application scenarios of multi-label image classification include multi-target recognition and detection, album classification, image semantic annotation, image retrieval, etc. [0003] Supervised deep learning methods driven by big data have achieved state-of-the-art performance in multiple computer vision application fields such as multi-label image classification. However, constructing a large-scale annotated trainin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/764G06V10/774G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/047G06N3/048G06N3/045G06F18/2155G06F18/2431G06F18/2415
Inventor 石伟伟吴少峰黑新宏赵志强王晓帆鲁晓锋费蓉
Owner XIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products