Ancient poetry generation method of based on image content

Abstract

The invention provides an ancient poetry generation method based on image content. The method comprises the steps that 1, target detection is conducted on image content objects based on a single-time multiple-frame target detection frame, and the names of the objects are obtained; 2, word separation is conducted on a set number of Tang poetries by using the Chinese lexical analysis tool, and a glossary is obtained, feature learning is conducted on each word in the glossary by using the word2vec tool, and each word is mapped to a vector space; 3, the obtained object names are inputted into the word2vec tool, a mapped vector of the object names is obtained, and the cosine similarity between the mapped vector and an ancient poetry vector is calculated, after a threshold is set, part of the object names selected are used as the corresponding subject term of the objects; 4, the subject term is utilized to expand the keywords, after the keywords are inputted and the Tang poetries are learned, a RNN model is obtained, and the ancient poetries are generated. According to the ancient poetry generation method, the method of target detection and the method of cyclic neural network algorithm are combined to generate ancient poetries, and the correlation between ancient poetries and image content is strong, and better coherence is achieved.

Description

technical field [0001] The invention relates to the fields of deep learning, computer vision and natural language processing, in particular to a method for generating ancient poems based on image content. Background technique [0002] With the rapid development of deep learning, deep learning frameworks represented by Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) have been widely used in the fields of computer vision and natural language processing. In terms of computer vision, based on the improved CNN framework, Deep Residual Networks (ResNet), Faster Region-Based Convolutional Neural Networks (Faster R-CNN), Fully Convolutional Neural Networks (FullyConnected Networks, FCN) achieved the best results in the fields of image classification, target detection, and target segmentation. In the field of natural language processing, the generation of traditional ancient poems is regarded as a machine translation problem. The previous poem is used as the ...

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the shortcomings of existing technical solutions that cannot generate ancient poems related to them according to the content of the image, the present invention proposes a method for generating ancient poems based on image content that effectively realizes the generation of ancient poems based on images, using a target detection algorithm and a recurrent neural network The method of combining algorithms generates ancient poems, and the ancient poems have a strong correlation with the content of the image and have better coherence

Images