The invention discloses an image classification method based on a semi-supervised self-paced learning cross-task deep network. The method includes the steps of randomly selecting a small amount of labeling samples from the whole image
data set, reserving the labels, and remaining all the samples as unlabelled samples having the real labels to be unknown in the whole process, wherein the weight ofthe labeled samples is constant to be one in the training process, the weight of the unlabelled samples is initialized to be zero, and only the labeled samples are used as a
training set in the initial process; S2, training a cross-task deep network by the
training set; S3, according to the trained cross-task deep network, predicting the pseudo labels of all the unlabelled samples, and giving a corresponding weight of each unlabelled sample; S4, according to a self-paced learning normal form, selecting an unlabelled sample with a high confidence degree, and adding to the
training set; and S5,repeating the steps S2-S4 until the cross-task deep
network performance is saturated or reaches a preset cycle number. According to the method, the human design feature is not needed to be input, andthe classification can be realized by directly inputting the original image.