A sketch image processing method and system based on knowledge distillation

Abstract

The invention discloses a knowledge distillation-based sketch image processing method and its system, comprising: obtaining a pre-trained teacher model composed of an image classification model, and extracting teacher features and teacher classification probabilities of sample images based on the teacher model; A student model for image classification based on the sketch image, and extract the first student feature and the first student classification probability of the sample image based on the student model, and extract the second student feature and the second student classification of the sample image corresponding to the sample sketch image based on the student model Probability; Computes classification loss and distillation loss based on teacher features, teacher classification probabilities, first student features, first student classification probabilities, second student features, and second student classification probabilities, and updates the student model based on classification losses and distillation losses; student The model generates zero-sample cross-modal retrieval results based on the sketch to be detected and the image to be queried.

Description

technical field [0001] The invention relates to the technical field of machine learning, in particular to a knowledge distillation-based sketch image processing method and system thereof. Background technique [0002] With the ubiquity of touchscreen devices, freehand sketches are becoming more and more accessible. Although the sketch graph exhibits a high degree of abstraction, it still contains enough structural details to describe its corresponding categories. Therefore, image retrieval based on sketch image has become a research hotspot in the field of machine learning technology. [0003] However, the existing sketch-based image retrieval methods all presuppose that the categories contained in the sketch to be queried and the image to be queried are exactly the same as those contained in the training model, without considering the sketch to be queried and The case where the queried image contains a category that was not included in the categories when the model was tr...

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a sketch image processing method and system based on knowledge distillation, which solves the problem of low accuracy in existing sketch image retrieval methods

Images