Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A self-adaptive weight deep learning target classification method based on feature fusion

A technology of self-adaptive weight and feature fusion, applied in the field of image recognition, can solve the problems of not considering the gain of classification accuracy, unsatisfactory classification effect, and different problems, so as to improve the recall rate, excellent detection ability, and high accuracy rate. Effect

Active Publication Date: 2019-06-14
HARBIN ENG UNIV
View PDF12 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the past, some scholars used to combine convolutional features with HOG features, often extracting one of the features first, and then extracting another feature on this basis, and classifying it through the support vector machine, but there are two problems in this method: first, The process of extracting one of the features will inevitably weaken the other feature; secondly, this process does not change the influence weight and loss function of each feature, and does not take into account that different features have different gains in classification accuracy
Therefore, the classification effect of the previous method is not ideal.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A self-adaptive weight deep learning target classification method based on feature fusion
  • A self-adaptive weight deep learning target classification method based on feature fusion
  • A self-adaptive weight deep learning target classification method based on feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The following examples describe the present invention in more detail.

[0042] Structural block diagram of the present invention is as figure 1 As shown, it involves Faster Rcnn network, Resnet network, SENet network, where Faster Rcnn network is used to complete the work of target recognition, Resnet network is used to extract image convolution features and HOG features, and SENet network is used to calculate the weight of feature maps Vector, and achieve the target classification task through feature fusion.

[0043] 1. Develop a low threshold-coarse detection strategy

[0044] The present invention uses the Faster-Rcnn target detection network containing the Roi-Align layer and the FPN structure to reduce the detectable threshold of the probability value calculated by the softmax function of the network output node and display more low-probability targets. These targets are used as backup Choose a target. In order to achieve the goal of improving the detection rec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a self-adaptive weight deep learning target classification method based on feature fusion. The method comprises performing target coarse detection; extracting image convolutionfeatures and HOG features, and performing dimension expansion processing on the HOG features; embedding the SENet into a Resnet network framework, and establishing a network framework for extracting multi-feature weights of the image; calculating adaptive weight vectors of the convolutional features and the HOG features, making a feature fusion strategy, and calculating image fusion features; andestablishing a multi-target classification framework based on the precise binary classification network set. According to the method, image convolution features and HOG features are fused, adaptive weight vectors of the image features are extracted, deep learning network configurations and parameters are designed, an accurate classification network is constructed, the network obtains more candidate frames by reducing a score threshold value, and the recall rate of target detection is increased; by designing a plurality of binary classification networks, the method has higher accuracy in termsof multi-classification problems.

Description

technical field [0001] The invention relates to a deep learning object classification method, in particular to an adaptive weight deep learning object classification method based on feature fusion, which belongs to the technical field of image recognition. Background technique [0002] Object classification technology is widely used in many fields. In recent years, the field of artificial intelligence has developed rapidly. Object classification technology has become an indispensable technical foundation in the field of artificial intelligence. Object classification can provide important information sources for video surveillance and automatic driving. For example, through object classification, it is provided whether there are pedestrians, vehicles, and buildings in the image. It can be said that accurate object classification technology is a technical bottleneck that needs to be solved in many fields. In the early days, people often used hand-designed features to extract i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/46
Inventor 王立鹏张智朱齐丹夏桂华苏丽栗蓬聂文昌
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products