Unsupervised domain adaptive method for beneficial feature alignment under class condition

A feature pair, conditional technology, applied in neural learning methods, computer components, instruments, etc., can solve the problems of sub-optimal performance, impact performance, underutilization of class-level distribution differences, etc., and achieve the effect of good domain adaptation.

Pending Publication Date: 2021-12-17
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Source and target domains basically overlap in task-related information, while redundant information from task-independent factors (such as background, color, and context) may be different in nature, and forcibly aligning these useless features may affect adaptation performance
In addition, in some existing UDA methods, there is another bottleneck: that is, the class-level distribution differences are not fully exploited during the adaptation process, and the distribution differences are only adapted at the domain level, while Differences that do not encode class-level information will make the learned features domain-invariant but class-indistinguishable, which can lead to misclassification, yielding suboptimal performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised domain adaptive method for beneficial feature alignment under class condition
  • Unsupervised domain adaptive method for beneficial feature alignment under class condition
  • Unsupervised domain adaptive method for beneficial feature alignment under class condition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] A framework for unsupervised domain adaptation methods for beneficial feature alignment under class conditions such as figure 1 shown. IC 2 The training of FA consists of two stages, which work alternately. In the first training stage, all source-domain images and target-domain images are applied to compute target pseudo-labels. The second stage consists of two main components, beneficial feature decoupling and discriminative feature alignment, both of which are integrated into a single framework and work together. Specifically include:

[0039] Calculate the source domain image and the target domain image to obtain the pseudo label of the target domain image, the source domain image is a marked image, and the target domain image is an unmarked image;

[0040] Use the variational information bottleneck to decouple the pseudo labels of the source domain image and the target domain image respectively, and obtain the beneficial and transferable features of the source d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unsupervised domain adaptive method for beneficial feature alignment under class conditions, and the method comprises the steps of calculating all source domain images and target domain images, and obtaining a pseudo tag of the target domain image; decoupling the pseudo labels of the source domain image and the target domain image through variational information bottlenecks, filtering features irrelevant to tasks out, and obtaining beneficial and migratable features; estimating intra-class difference and inter-class spacing by using a conditional slice Wharisstein distance, minimizing the intra-class difference and maximizing the inter-class spacing in a cross-domain manner, reducing class-level distribution difference between a source domain and a target domain, and obtaining domain-invariant discriminant features. According to the method, decoupling of a source domain and a target domain can be achieved, class-level information is embedded into the slice Weiisstein distance, beneficial feature alignment is achieved, and meanwhile beneficial feature decoupling and class condition feature alignment are achieved so as to promote better domain adaptation.

Description

technical field [0001] The invention belongs to the field of unsupervised domain self-adaptation, in particular to an unsupervised domain self-adaptive method for beneficial feature alignment under class conditions. Background technique [0002] Deep Neural Networks (DNNs) have achieved significant progress in various tasks, such as image classification, object detection, image segmentation, face recognition, etc. However, these impressive advances depend on the strict assumption that large amounts of well-labeled data are available for model learning in domains of interest. Manual labeling is often costly and labor-intensive; especially for data-sensitive domains such as medical images and industrial inspections, labeled samples are not even available. [0003] A general strategy (such as transfer learning) operates by reusing knowledge / models learned from available related domains (called source domains) into domains of interest (called target domains). Unfortunately, th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/62G06N3/08
CPCG06N3/088G06F18/23213G06F18/24G06F18/295G06F18/214
Inventor 黄安邓婉霞刘丽
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products