Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data enhancement learning and training method, electronic equipment and readable storage medium

A technology for enhancing learning and training methods, applied in the field of video processing, it can solve the problems that cannot be integrated into unsupervised or semi-supervised learning, and cannot be applied in the video field, so as to achieve the effect of low computational cost and avoidance of demand.

Pending Publication Date: 2020-12-01
NEXWISE INTELLIGENCE CHINA LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the significant disadvantage of MixUp is that it must have real data labels, so it can only be used in supervised scenarios, and cannot be integrated into unsupervised or semi-supervised learning.
In addition, mixup has only verified its effectiveness in the image field, and it cannot be applied in the video field
The existence of these difficulties has led to the exploration of video data enhancement for a long time only in simple rotation and color dithering.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data enhancement learning and training method, electronic equipment and readable storage medium
  • Data enhancement learning and training method, electronic equipment and readable storage medium
  • Data enhancement learning and training method, electronic equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0036] Consistency regularization applies data augmentation to semi-supervised learning, exploiting the idea that classifiers should output the same content for videos with the same distribution. There are many semi-supervised learning methods based on consistency regularization. A new form of consistency regularization is proposed in an embodime...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data enhancement learning and training method, electronic equipment and a readable storage medium. The method comprises the following steps: mixing a staticimage into each frame of a sample video according to a scale factor; according to the embodiment of the invention, a data enhancement method TCA is utilized to guide the learning target of the whole neural network; the TCA can be simply integrated in any neural network, specifically, a static image is mixed into each frame of a sample video according to a scale factor, and the similarity of time clues under different space contexts can be reserved by selecting a proper scale factor. In addition, the TCA can be realized through simple matrix operation, the calculation overhead is very low, themethod provided by the embodiment of the invention achieves the optimal effect on three data sets, the effectiveness of the data enhancement method is verified, the TCA avoids the requirement on a real label, and the method can be expanded to self-supervised and semi-supervised learning.

Description

technical field [0001] The invention relates to the technical field of video processing, in particular to a data reinforcement learning, a training method, an electronic device, and a readable storage medium. Background technique [0002] Data Augmentation is a very common technique in deep learning. In image classification, the input image is usually elastically deformed or noise is added, which can greatly change the pixel content of the image without changing the label. Based on this, many enhancement techniques for rotation are proposed, such as flipping and color dithering. Data augmentation can improve the diversity of samples and greatly improve the robustness of the model. [0003] The existing MixUp is a practical image classification data enhancement method, and its effectiveness has been verified in the image-based field. For the samples in the data set, in the training process, all samples are first divided into different batches and randomly Sample one of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08G06N3/02
CPCG06N3/08G06N3/02
Inventor 王金鹏王金桥赵朝阳胡建国林格张海朱贵波唐明
Owner NEXWISE INTELLIGENCE CHINA LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products