High-speed big data integration system

Abstract

The invention discloses a high-speed big data integration system. The high-speed big data integration system comprises an information acquiring module, an information integrating and analyzing module, a data integrating module and a data service module. The information acquiring module is used for acquiring data from multiple data sources. The information integrating and analyzing module is used for analyzing and processing the acquired data. The data integrating module is used for classifying and integrating the data processed by the information integrating and analyzing module. The data service module is used for interfacing with users. By an information integration process, the linked and acquired data are subjected to formatted processes including duplication eliminating, semantic analysis, automatic clustering, automatic classification, Chinese word segmentation, segmentation finishing and the like, and then are integrated and classified by an intermediate platform for system information integration, so that users can apply the data by means of retrieving, querying, analyzing, monitoring, subscribing for and the like.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a high-speed big data integration system. Background technique [0002] After years of development of my country's informatization, many computer information systems and database systems have been developed, and a large amount of basic data has been accumulated. However, due to the different construction periods, different development departments, different equipment used, different technological development stages and different ability levels of rich data resources, data storage management is extremely scattered, resulting in excessive data redundancy and data inconsistency, making data Resources are difficult to query and access, and the management cannot obtain effective decision-making data support. Often managers need to access many different systems to understand the information of different departments under their jurisdiction, and the data cannot be directly compare...

AI Technical Summary

Problems solved by technology

[0006] At the same time, with the increase in the number of computer businesses, the operations of managers are becoming more and more complex, and many increasingly complex intermediate business processing links still rely more or less on manual processing; information processing and analysis methods are poor. , it is impossible to directly collect data from all types of business information systems at all levels and make comprehensive use of them, and it is impossible to collect and feedback external information in a timely and accurate manner. departments; the existing business information system platforms and development tools are incompatible with each other and cannot be applied in a wide range, etc.

Images