Text label construction method and device, computer equipment and storage medium

Abstract

The invention relates to a text label construction method and device, computer equipment and a storage medium. The method comprises the steps of obtaining to-be-processed text data, performing word segmentation processing on the to-be-processed text data to obtain a word segmentation set, training the word segmentation set through word2vec to obtain similarity among words in the word segmentationset, performing word clustering based on the similarity among the words, and constructing a text label according to a word clustering result. Whole process, the similarity between words in the text data is accurately obtained through word2vec training, clustering is carried out based on the similarity between the words, accurate clustering can be achieved in an iterative clustering mode in the clustering process, and labels of the text data can be reasonably and accurately constructed based on the clustering result of accurate clustering.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a method, device, computer equipment and storage medium for constructing tags in text tags. Background technique [0002] With the rapid development of computers and the Internet, text document data has grown exponentially. However, in the face of such a huge amount of data, how to dig out useful information and how to quickly retrieve data has always been an important problem faced by people. [0003] Among them, the use of tag construction plays an important role in the utilization of document data. For example, UGC (User Generated Content, User Generated Content) classification and clustering, indexing, topic search, topic crawler, and recommendation systems can be performed based on tags. In addition to the above applications, another common use of tag building is news or blogging. By extracting keywords from news or blogs, readers can understand the content of ...

AI Technical Summary

Problems solved by technology

However, most of the conventional label construction methods are based on keywords and other methods. This kind of label implementation is generally applicable to situations such as sites, article regions, etc. It is not suitable for the creation of labels in big data texts, and cannot accurately realize the label creation

Images