Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Continuous learning image recognition method and device based on model parameters and pruning strategy

An image recognition and model parameter technology, applied in the field of image processing, can solve problems such as poor image recognition accuracy, and achieve the effects of slowing down the growth rate, improving image recognition efficiency, and saving computing costs

Pending Publication Date: 2022-04-29
SUN YAT SEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the above methods alleviate catastrophic forgetting to a certain extent, the accuracy of image recognition is still poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Continuous learning image recognition method and device based on model parameters and pruning strategy
  • Continuous learning image recognition method and device based on model parameters and pruning strategy
  • Continuous learning image recognition method and device based on model parameters and pruning strategy

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0059] Such as figure 1 As shown, this embodiment provides a continuous learning image recognition method based on model parameters and pruning strategies, including the following steps:

[0060] S1. Collect new category data and historical category data;

[0061] S2, build continuous learning image recognition model, including multiple feature extractors, multiple FC layers and NME classifiers; feature extractors are used to extract the features of category image data; FC layers are used to filter features; NME classifiers are used for Classify features;

[0062] S3. Merge the newly added category data with some old category data saved by the Rehearsal strategy to form training data;

[0063] S4. Input the training data into the continuous learning image recognition model, and add a new feature extractor and FC layer;

[0064] S5. Use knowledge distillation to train the continuous learning image recognition model, and use the pruning strategy to remove unimportant convolut...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a continuous learning image recognition method and device based on model parameters and a pruning strategy. The method comprises the steps of collecting newly-added category data and historical category data; constructing a continuous learning image recognition model; merging the newly added category data with a part of old category data stored by the Rehearsal strategy to form training data; inputting a continuous learning image recognition model, and adding a feature extractor and an FC layer; using knowledge distillation to train a continuous learning image recognition model, and using a pruning strategy to remove unimportant convolution kernels in a newly added feature extractor; a Rehearsal strategy is used for the newly-added category data and the historical category data, and part of category data is stored; and inputting the to-be-tested data into the continuous learning image recognition model for testing to obtain an image recognition result. According to the method, from the angle of model parameters, the problem of continuous learning in image recognition is solved by adopting knowledge distillation, the increasing speed of model parameter quantity is slowed down in combination with a pruning strategy, and the accuracy and efficiency of image recognition are improved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a continuous learning image recognition method and device based on model parameters and pruning strategies. Background technique [0002] Image recognition is an image processing method that distinguishes different categories of targets according to the different characteristics of the target reflected in the image information. In the field of image recognition, historical category image data is usually used to train the model, but when a new category appears For image data, historical category image data cannot be used due to various reasons, such as data loss. At this time, the model can only be retrained with new category image data, and the new category image data can be identified by adjusting parameters. But this will cause the model to forget or even completely forget the historical task, which is called catastrophic forgetting. Generally, continuous ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08G06N3/04G06V10/774G06V10/82G06V10/44G06V10/764G06K9/62
CPCG06N3/082G06N3/045G06F18/214G06F18/24
Inventor 王瑞轩李焯昀
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products