Distributed storage and indexing method based on knowledge graph RDF data characteristics

Abstract

The invention relates to the field of distributed graph storage, and aims to solve the problems of small storage capacity, high maintenance cost, low execution efficiency and the like of a single machine and improve the execution efficiency of multiple types of queries. The distributed storage and indexing method based on the knowledge graph RDF data characteristics comprises the following steps of processing stored data, counting data information, and mining associated information in a data set; through the data information in the step 1), constructing an effective entity aggregation index between the triple classes; performing ontology division processing on each entity class based on the statistical information, increasing a predicate aggregation degree contained in the entity class, and establishing a predicate pointing index; carrying out connection operation on the data set, and storing a connection special class so as to improve the star query efficiency with extremely high occurrence frequency; grading the data set based on the above steps, and ensuring that the data is stored in a descending order according to a defined grade; for an input query, introducing query optimization. The method is mainly applied to distributed graph storage occasions.

Description

technical field [0001] The invention relates to the field of distributed graph storage, in particular to the field of storage for large-scale RDF knowledge graphs. Background technique [0002] RDF (Resource Description Framework), a resource description framework, is a markup language used to describe Web resources. It can also be said to be a standard data model for representing and exchanging machine-understandable information in the Semantic Web. RDF uses a triplet of subject, predicate, and object to describe the metadata of a data, which is (s, p, o), where s is the subject, p is the predicate, and o is the object object. RDF data is used in many fields because of its simplicity, openness, and scalability. With the popularity of the Internet, the scale of RDF data continues to increase. The efficient storage and query of RDF data has become a research hotspot. RDF graph is the most intuitive representation of RDF data. [0003] Knowledge graph is an important part of...

AI Technical Summary

Problems solved by technology

[0012] In order to overcome the deficiencies of the existing technology, the present invention aims to solve the problems of small storage capacity, high maintenance cost, and low execution efficiency of a single machine, and give full play to the advantages of large distributed storage capacity, easy maintenance, and the ability to increase linear execution to improve machine performance. In the case of ensuring moderate storage overhead, through data mining, index construction and other strategies, the execution efficiency of various types of queries is improved

Images