A deep learning method with stable performance

A deep learning and stable performance technology, applied in the field of deep learning, can solve the problems of accuracy rate drop and achieve the effect of stabilizing the test accuracy rate

Active Publication Date: 2022-07-08
TSINGHUA UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The present invention can be applied to image recognition systems and target detection systems that have cross-distribution problems, and solves the problem of accuracy drop caused by distribution offsets between training data and test data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A deep learning method with stable performance
  • A deep learning method with stable performance
  • A deep learning method with stable performance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention proposes a deep learning method with stable performance, and the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0028] The present invention proposes a deep learning method with stable performance. The overall process is as follows: figure 1 shown, including the following steps:

[0029] 1) Obtain the training data set;

[0030] Obtain a labeled image dataset that can be used for classification tasks as a training dataset, and each training sample in the training dataset contains an image and a classification label corresponding to the image. The stronger the heterogeneity in the training data, the better the effect of this method.

[0031] 2) Build a deep learning network:

[0032] The deep learning network of the present invention is composed of a deep feature extractor g (using a convolutional network) and a classifier f. The input of the deep feature extractor i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a deep learning method with stable performance, which belongs to the technical field of deep learning. The method obtains a labeled image dataset as a training dataset, and constructs a deep learning network composed of a deep feature extractor and a classifier; randomly selects a batch of samples from the training dataset and inputs it into the network, wherein the deep feature extraction The device outputs the original features of the batch of samples and undergoes random Fourier feature transformation to obtain the corresponding random Fourier representation matrix; uses the random Fourier representation matrix to detect the independence of the original features, and trains to obtain the corresponding weights of each sample; After re-weighting the predicted loss value, the final training loss value is obtained and the network parameters are updated until the end of the deep learning network training. The present invention can be applied to a picture recognition system and a target detection system with cross-distribution problems, and solves the problem of accuracy drop caused by the deviation of the distribution of training data and test data.

Description

technical field [0001] The invention belongs to the technical fields of image recognition, object detection and the like, and particularly proposes a deep learning method with stable performance. Background technique [0002] At present, deep learning has made unprecedented progress in many research fields, especially in the field of computer vision (such as image recognition, object detection and other technical fields). For example, residual convolutional networks can greatly improve the recognition accuracy of images by computer vision recognition systems. Based on The convolutional network of the region can greatly improve the accuracy of the object detection system and so on. Many deep learning-based computer vision techniques have far surpassed traditional methods. [0003] However, most of the current machine learning and deep learning algorithms assume that the training data and test data are independent and identically distributed, and have achieved very good resul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/44G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/04G06N3/084G06V10/44G06F18/241
Inventor 崔鹏张兴璇
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products