Method for constructing and displaying multi-modal emotion knowledge graph

Abstract

The invention provides a method for constructing and displaying a multi-modal emotion knowledge graph, and relates to the technical field of multi-modal knowledge management. The method comprises thesteps: firstly, collecting and downloading emotion vocabulary bodies or dictionaries, facial expression and animal expression images and emoticons commonly used by social media platforms; respectivelypreprocessing the acquired text and image data resources to enable the data resources to meet the requirements of a unified abstract ontology model; then constructing a multi-modal emotion knowledgegraph capable of expressing different modal entities and relationships between the entities based on preprocessing results of the text emotion words, the expression images and the social media emoticons; and finally, achieving display and rendering of nodes of the multi-modal emotion knowledge graph, edges of the graph and graph entity attribute information by adopting programming of a text markuplanguage of a front end and an element rendering language of a front end page. On the basis, a user interaction function of the map is achieved; and meanwhile, the dynamic effect of the knowledge graph is improved through the graphic visualization library.

Description

technical field [0001] The invention relates to the technical field of multimodal knowledge management, in particular to a method for constructing and displaying a multimodal emotional knowledge map. Background technique [0002] Knowledge Graph is a large-scale structured data collection, which is used to describe various entities and concepts in the real world, as well as the relationship between entities and entities, entities and concepts, and concepts and concepts. The group (h, r, t) consists of (h, r, t denote head entity, relation, tail entity, respectively). The knowledge graph uses a graph model to display knowledge concepts (head and tail entities) and their relationships, which are composed of nodes and edges. At present, the research and application of knowledge graph technology have achieved considerable results, and a large number of general or specific domain knowledge graphs have appeared, which have played an important role in applications such as informat...

AI Technical Summary

Problems solved by technology

However, the research as a complete multimodal knowledge graph is still in its infancy, and the research results of the multimodal emotional knowledge graph have not been reported yet.

Images