Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fine-grained image recognition algorithm for distributed labels based on inter-class similarity

An image recognition and similarity technology, which is applied in the field of fine-grained image recognition algorithms for distributed labels, can solve problems such as large visual differences in images and large image differences, and achieve the effect of avoiding over-fitting problems

Active Publication Date: 2021-07-23
NANJING UNIV OF SCI & TECH
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, network models suitable for general image recognition (coarse-grained image recognition) tasks cannot achieve ideal results in fine-grained recognition tasks, mainly because of the following two factors: (1) Small differences between image classes: due to the fine-grained Categories belong to the same large category (for example, Acura RL Sedan 2012 and Buick Verano Sedan 2012 both belong to the parent category of car), so images of different categories tend to have similar features, which leads to high similarity between fine-grained categories (2) Large differences within image classes: Due to the differences in illumination, angle, occlusion, and even the parameter performance of the acquisition equipment during the image acquisition process, images of the same class often have large visual differences, especially the similarity between fine-grained classes The existence of high degrees makes the large difference between images in the same category become particularly obvious in fine-grained recognition tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fine-grained image recognition algorithm for distributed labels based on inter-class similarity
  • Fine-grained image recognition algorithm for distributed labels based on inter-class similarity
  • Fine-grained image recognition algorithm for distributed labels based on inter-class similarity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The present invention will be described in detail below in conjunction with the embodiments.

[0047] Such as figure 1 As shown, the fine-grained image recognition algorithm based on distributed labels between classes includes the following steps:

[0048](1) Use the backbone network to extract the feature representation X of the input image, and the extracted image feature representation is input to two parallel modules; the modules are a central loss module and a classification loss module;

[0049] Using the CUB200-2011 dataset, which is the most widely used image dataset in fine-grained recognition tasks, the full name is Caltech-UCSD Birds-200-2011, the dataset contains 200 categories of birds, a total of 11788 Image of bird. Usually the images of this data set are divided into 5994 training images (about 30 training images for each type of bird) and 5794 test images. In addition, in this data set, each picture contains a category label of a bird in an image, a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fine-grained image recognition algorithm of distributed labels based on inter-class similarity. The fine-grained image recognition algorithm comprises the following steps: (1) extracting feature representation of an input image by using a backbone network; (2) calculating center loss and updating a category center by utilizing a center loss module through feature representation; (3) calculating, by a classification loss module, classification loss (such as cross entropy loss) by using the feature representation and final label distribution, wherein the final label distribution is obtained by calculating the weighted sum of one-hot label distribution and distributed label distribution generated by a category center; and (4) performing weighted summation on the center loss and the classification loss to obtain a final target loss function so as to optimize the whole model. The problem of overfitting is effectively relieved by reducing the certainty degree of model prediction, discriminative features of fine-grained data can be accurately learned, data of different fine-grained categories can be accurately and efficiently distinguished, and the invention can be widely applied to the fields of visual classification and multimedia.

Description

technical field [0001] The invention relates to a fine-grained image recognition method, in particular to a fine-grained image recognition algorithm based on distributed labels between classes. Background technique [0002] Image recognition, which aims to classify a given image, is a core research topic in the field of computer vision. General image recognition tasks (such as distinguishing airplanes, ships, dogs, cats, animals, etc., distinguishing different handwritten digits, distinguishing various objects of different classes, etc.) aim to classify and recognize images of different categories. Fine-grained image recognition, as an important and challenging subclass of image recognition, has been an active research field in computer vision. The goal of fine-grained recognition tasks is to identify different subcategories under the same category (such as distinguishing different categories of birds, airplanes, cars, etc.). In real life, fine-grained image recognition ha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/44G06N3/045G06F18/22G06F18/2415Y02A90/10
Inventor 唐振民孙泽人姚亚洲杜鹏桢
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products