Probability domain generalization learning method based on meta-learning

A learning method and meta-learning technology, applied in the field of meta-learning, to achieve the effect of increasing generalization ability

Pending Publication Date: 2020-05-19
GUANGDONG UNIV OF PETROCHEMICAL TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Aiming at the problems existing in the prior art, the purpose of the present invention is to provide a probabilistic domain generalization learning method based on meta-learning, which can realize the first combination of meta-learning ideas into domain generalization, and use meta-learning framework to solve domain The problem that the parameters increase linearly with the increase of the number of source domains; the first time the idea of ​​variational information bottleneck is combined with meta-learning and domain generalization, which can further increase the generalization ability of this

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Probability domain generalization learning method based on meta-learning
  • Probability domain generalization learning method based on meta-learning
  • Probability domain generalization learning method based on meta-learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] A probabilistic domain generalization learning method based on meta-learning, comprising the following steps:

[0062] Input: training dataset S with K source domains, learning rate λ, number of iterations N iter ;

[0063] Output: parameters θ, including parameters of a feature extraction network h and two inference network parameters g1 and g2; classification model parameters ψ;

[0064] S1. Randomly select one of the K source domains as the target domain, and the remaining K-1 as the source domain;

[0065] S2. From each source domain D s Select M samples that contain C categories, expressed as

[0066]

[0067] S3, from the target domain D t N samples are selected in , expressed as

[0068]

[0069] S4. For the source domain data set D s Every sample of class c The features extracted by convolutional neural network are as follows:

[0070]

[0071] S5. For samples of each category in the source domain dataset Ds, use the permutation-invariant insta...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a probability domain generalization learning method based on meta-learning, belongs to the field of meta-learning, and aims to combine a meta-learning thought into domain generalization for the first time and solve the problem that parameters are linearly increased along with increase of the number of source domains in domain generalization by utilizing a meta-learning framework. The variational information bottleneck idea is combined into meta-learning and domain generalization for the first time, so that the generalization ability of the patent can be further improved; according to the method, the problem that parameters linearly increase along with the number of source domains can be solved through meta-learning; according to the technical scheme, the probabilitydomain generalization learning method based on meta-learning is formed by combining the variational thought with the information bottleneck and fusing the variational thought and the information bottleneck into a unified probability framework, and the brand-new and effective probability domain generalization learning method based on meta-learning can be formed by combining the variational thoughtwith the information bottleneck.

Description

technical field [0001] The invention relates to the field of meta-learning, and more specifically, relates to a meta-learning-based generalization learning method in probability domain. Background technique [0002] Traditional machine learning assumes that training data and test data obey the same data distribution, which is difficult to meet in practical applications. There are several classical approaches to this problem, including 1) transfer learning: the goal of transfer learning is to use knowledge learned from one environment to help learning tasks in a new environment; 2) domain adaptation: the focus of domain adaptive learning It lies in how to overcome the difference between the distribution of the source domain and the distribution of the target domain, and realize the learning task on the target domain; 3) domain generalization: when the target domain is unknowable, the distribution or model has good characteristics for unknown situations. The difficulty of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N20/00G06K9/62G06N3/04G06N5/04
CPCG06N20/00G06N5/04G06N3/045G06F18/24G06F18/214
Inventor 甄先通张磊李欣左利云简治平蔡泽涛
Owner GUANGDONG UNIV OF PETROCHEMICAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products