Complex information analysis engine architecture

Abstract

The complex information analysis engine architecture disclosed by the invention is high in retrieval efficiency, and the data processing capability can be better improved. According to the technical scheme, a data collection / extraction module collects data into a data pool through data collection; the data understanding module is used for processing the unstructured data, and the data structuring module is used for structuring storage in a classified manner by utilizing the extracted key feature information of the event feature set to finish conversion from the unstructured data to the structured data; the index module performs forward indexing or reverse indexing on the structured data, and the retrieval module performs data retrieval in the structured data pool library to obtain a data set matched with the query word; the multi-dimensional modeling module is used for achieving data multi-dimensional modeling based on data mining of statistical characteristics; the simulation deduction module calls associated elements to generate a simulation deduction structured data set; and the interactive analysis module presents an analysis result of the multi-dimensional modeling and a deduction result of the simulation deduction to a user.

Description

technical field [0001] The present invention relates to the field of information processing, in particular to a complex information analysis engine architecture Background technique [0002] In the era of big data, the amount of data is increasing geometrically, and its complexity is also greatly increased while the content is expanded and enriched. The analysis and use of data is not limited to traditional statistics, classification, and aggregation, but requires deeper understanding and mining. Information overload makes it difficult to obtain useful information, which is not conducive to the understanding and analysis of information. In this era of information explosion, the problem faced by every system and everyone is no longer unable to obtain information, but how to quickly obtain valuable content from massive information and prevent useless information from drowning out valuable information . The massive message system not only has certain requirements for the rel...

AI Technical Summary

Problems solved by technology

But the problem with the rules is that the pattern of known conclusions cannot be identified for unknown attacks, so he does not need to consider historical events

Images