Multi-source risk control data cleaning processing method

Abstract

The invention relates to the technical field of risk control data processing, in particular to a multi-source risk control data cleaning processing method. The method comprises the steps of collectinghistorical data and enabling a system to import risk control historical data in a full import mode; carrying out real-time data acquisition: enabling the system to acquire increment change based on adatabase log analysis mode to realize real-time data synchronization; performing pattern matching: performing pattern matching on the data on the basis of the similarity of the attributes; making semantic conversion: converting the attribute data of each heterogeneous data source into standard data; filtering invalid information and recognizing and eliminating wrong data and repeated data; encrypting data: encrypting original data; and making data compression: carrying out lossless compression processing on the original data. The data designed by the invention adopts a multi-source acquisition mode, and meanwhile, unification of the data is realized, data processing is facilitated, invalid data can be reduced, and the data processing efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of wind control data processing, in particular to a method for cleaning and processing multi-source wind control data. Background technique [0002] Risks exist in all business activities. The sources of risks are different, and the strategies, data, and models required to evaluate risks will vary widely. Therefore, the way to avoid risks is to analyze risks, master their laws, and realize risk control. Risk control requires the collection of multi-source data. Due to different data sources, the types of data are different, and unified analysis cannot be performed. At the same time, the data contains a lot of useless data. When analyzing, the amount of data analysis is huge, resulting in low data analysis efficiency. Contents of the invention [0003] The purpose of the present invention is to provide a method for cleaning and processing multi-source risk control data, so as to solve the problems r...

AI Technical Summary

Problems solved by technology

[0002] Risks exist in all business activities. The sources of risks are different, and the strategies, data, and models needed to assess risks will vary widely. Therefore, the way to avoid risks is to analyze risks, master their laws, and realize risk control. Risk control requires the collection of multi-source data. Due to different data sources, the types of data are different, and unified analysis cannot be performed. At the same time, the data contains a large amount of useless data. When analyzing, the amount of data analysis is huge, resulting in low data analysis efficiency.

Images