Large data visualization analysis and processing system for enterprise operation data analysis

Abstract

The invention relates to a large data visualization analysis and processing system for enterprise operation data analysis, which is characterized by comprising a data source judgment module, a data collection module, a data storage module, a data cleaning module, a data standardization processing module, and a background task scheduling module, wherein the data source judgment module is used for judging a data source for adopting a corresponding data collection mode; the data collection module collects data according to the corresponding data collection mode; the data storage module stores the data collected by the data collection module into to-be-cleaned data; the data cleaning module carries out data cleaning on the to-be-cleaned data and generates already-cleaned data; the data standardization processing module carries out standardization processing on the already-cleaned data, and a public navigation field is generated and stored to a data pool; and the background task scheduling module calls a built analysis model to analyze the data in the data pool and generates a visualization analysis result report. Compared with the prior art, the system of the invention has the advantages that the working efficiency is improved, cross-system data analysis is supported, secrecy is high and the like.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a big data visualization analysis and processing system used for analyzing business operation data of an enterprise. Background technique [0002] Enterprise data analysis is the foundation of modern enterprise management. The main functions of enterprise operation data analysis are: information function, consulting function and supervision function. The scope of enterprise operation data analysis mainly includes: enterprise environment and condition data analysis; enterprise output data analysis; enterprise operation effect evaluation data analysis; enterprise development strategy data analysis Wait. An important link before the analysis of enterprise data is the collection and arrangement of enterprise business data. The business data collection technology is to use comprehensive surveys (statistical ledgers, original records, etc.) for some direct data companies, and sampl...

AI Technical Summary

Problems solved by technology

[0004] 1. In large-scale enterprises, the various systems of business operation and management are often built by different departments at different times, and their data storage formats are different, and there are often various situations such as data redundancy and data inconsistency. , it is difficult to carry out cross-system data collection and correlation analysis

[0005] 2. Business personnel do not master the underlying data structure and cannot directly establish an analysis model. Only with the help of technical personnel can they analyze the data effectively, which affects the confidentiality and timeliness of the data analysis work, and cannot well satisfy the data analysis business. Require

[0006] 3. Quite a lot of historical data in the business department is stored in non-formatted form (such as word documents), which cannot form an effective knowledge system, which is not conducive to the inheritance and application of knowledge

[0007] 4. Many external data of enterprises are of great help to enterprise data analysis (such as public information of courts and commercial departments, etc.), but these data are often in various formats and scattered in locations, so they can only be searched and analyzed manually

Images