Deep learning model-based image Chinese description method

Abstract

The invention discloses a deep learning model-based image Chinese description method and belongs to the field of computer vision and natural language processing. The method comprises the steps of preparing an ImageNet image data set and an AI Challenger image Chinese description data set; pre-training the ImageNet image data set by utilizing a DCNN to obtain a pre-trained DCNN model; performing image feature extraction and image feature mapping on the AI Challenger image Chinese description data set, and transmitting image features to a GRU threshold recursive network recurrent neural network;performing word coding matrix construction on an AI Challenger image mark set in the AI Challenger image Chinese description data set; extracting word embedding features by utilizing an NNLM, and finishing text feature mapping; taking the GRU threshold recursive network recurrent neural network as a language generation model, and finishing image description model building; and generating a Chinese description statement. According to the method, the blank of image Chinese description is filled up; a function of automatically generating the image Chinese description is realized; the accuracy ofdescription contents is well improved; and a foundation is laid for development of Chinese NLP and computer vision.

Description

technical field [0001] A Chinese image description method based on a deep learning model of the present invention belongs to the field of computer vision and natural language processing. Background technique [0002] With the development of multimedia and the expansion of the Internet scale, the popularization of hardware devices such as mobile phones and tablets has made the image resources in the Internet grow exponentially. This brings great difficulties to users in image retrieval on the Internet, and it has become impossible to manually label these images. In order to ensure that images can be accurately retrieved by users within a limited time, This needs to enable the machine to automatically understand the content in the image and automatically label the image. Thereby, it is convenient for users to search. [0003] The current image description methods are all based on English text description of images. It is an urgent task to design a Chinese semantic understand...

AI Technical Summary

Problems solved by technology

Secondly, in the current English text description methods, most of these methods are based on codec rules, and the limitation of this method is that it cannot accurately and completely describe the content of the image in English for complex scenes.

Images