Generic similarity calculation method and system based on heterogeneous information network

Abstract

The present invention discloses a generic similarity calculation method based on a heterogeneous information network, comprising steps of: step 1, preprocessing an input data set, to ensure validity of input data; step 2, performing metadata extraction: extracting description information of the input data, and storing the description information in a metadata library; step 3, establishing a heterogeneous information network mode via user interaction, and storing the network mode; step 4, performing similarity calculation by using a metapath-based similarity calculation method of the heterogeneous information network; step 5, performing post similarity processing, to form overall similarity as final output. The generic similarity calculation method and system based on a heterogeneous information network have the beneficial effects: modeling is performed by using the heterogeneous information network, and a generic similarity calculation method is proposed; different types of data sets can be processed; various demands of similarity calculation can be met; a user can designate various calculation methods and post-result processing manners; the degree of freedom of selection is high; the calculation accuracy and efficiency are improved; and the problem of information overload is better solved.

Description

technical field [0001] The present invention relates to the fields of information technology and Internet technology, in particular, to a general heterogeneous information network-based similarity calculation method and system. Background technique [0002] With the development of information technology and the Internet, people have gradually entered the era of information overload from the early data scarcity. Especially in the current era of big data, how to solve the problem of information overload and extract valuable information from massive data is a key issue that people urgently need to solve. Whether in various information retrieval systems or in various personalized recommendation systems and applications, information similarity calculation is a key technology in these systems and applications, and usually plays a decisive role in the processing accuracy of related systems and applications. [0003] Heterogeneous information network is a relatively new research fi...

AI Technical Summary

Problems solved by technology

[0005] At present, some traditional calculation methods for calculating the similarity between entities in the real world are usually only for specific data, the method is simple and fixed, and cannot well reflect the rich relationship between entities in the real world, lacking a general calculation method and The framework usually uses some simple similarity calculation methods, and only considers few relatively fixed attributes between data and data in the calculation process. When considering different types of data and different attributes of data, it must be re- Consider the calculation method and need to re-modify the system, resulting in poor versatility, low calculation efficiency and low accuracy of the results, which cannot meet the requirements of today's big data era.

Images