Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A social image recommendation method based on hierarchical attention mechanism

A social image and recommendation method technology, applied in the field of social image recommendation based on hierarchical attention, can solve the problem of not using the user's intrinsic attributes

Inactive Publication Date: 2019-03-01
HEFEI UNIV OF TECH
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the collaborative filtering method based on image visual features only considers the intrinsic attributes of items and does not take advantage of the intrinsic attributes of users.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A social image recommendation method based on hierarchical attention mechanism
  • A social image recommendation method based on hierarchical attention mechanism
  • A social image recommendation method based on hierarchical attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0120] In order to verify the effectiveness of this method, the present invention grabs a large number of images from the social image sharing platform Flickr as a data set, which is extended from the widely used NUS-WIDE data set. Filter users with less than 2 social links and less than 2 rating records, and call the filtered data set F_L data set. The F_L dataset is further filtered to ensure that each user and each image has at least 10 records, resulting in the F_S dataset.

[0121] The present invention adopts Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG) as evaluation criteria. Six methods were selected to compare the effects with the methods proposed in this paper, namely BPR, VBPR, ACF, SR, ContextMF and VPOI. Specifically, according to the experimental results, the results can be drawn as Figure 2a , Figure 2b As shown, the experimental results show that the method proposed by the present invention is better than the selected 6 methods on the da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a social image recommendation method based on the hierarchical attention mechanism, which comprises the following steps: 1. Constructing heterogeneous data: a scoring matrix ofan image by a user, an uploading information matrix of the image by the user, and a social relationship matrix between the user and the user; 2. Processing heterogeneous data and image set to obtainsocial embedding matrix, content embedding matrix and style embedding matrix; 3. Input that embedding matrix into the bottom attention network to obtain the social semantic information; 4. The weightsof the three aspects of the social semantic information obtained from the top-level attention network when the user chooses the image; 5. According to the feature matrix, three kinds of social semantic information matrices and their weights, we can get the scoring prediction value, and then we can recommend the image. The invention not only effectively solves the problem of data sparsity by usingthe uploading information of the user and the social information among the users, but also well explains the user preference through the hierarchical attention mechanism, and realizes the accurate social image recommendation.

Description

technical field [0001] The invention relates to the field of image recommendation, in particular to a hierarchical attention-based social image recommendation method. technical background [0002] Image-based social networks have become the most popular social networks in recent years. With the rapid increase of mobile phone users, many users take pictures and upload them to social networking platforms to share their lives. A large number of uploaded images lead to image overload. How to understand the preferences of different users and make accurate image recommendations has become an urgent need. [0003] Collaborative filtering algorithm can effectively solve the problem of image recommendation. It discovers user preferences and makes recommendations by mining user historical behavior data. Although the collaborative filtering algorithm is widely used, the sparseness of the user-image interaction behavior matrix limits its recommendation performance. In order to solve ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q50/00G06N3/04G06F16/9535
CPCG06Q50/01G06N3/045
Inventor 吴乐陈雷汪萌洪日昌杨永晖
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products