Method for realizing data standard and data quality association processing based on metadata in big data governance

Abstract

The invention relates to a method for realizing data standard and data quality association processing based on metadata in big data governance. The method comprises the following steps: (1) collectingmetadata; (2) importing an enterprise data standard; (3) classifying the metadata according to a data standard, and storing the metadata by taking a data standard number as a key field; (4) making adata quality standard according to the data standard; (5) compiling a quality rule according to the data quality standard; and (6) checking the metadata according to the quality rule. The metadata-based data standard and data quality association processing method in big data governance is adopted. The barriers of business requirements and technical requirements of enterprises in data management are broken through. According to the technical scheme, rectification suggestions can be given according to data standard requirements. The complete closed loop in enterprise big data management is realized by taking business as a target and taking a technology as a means, and the method has important significance for improving data quality of enterprises, standardizing data definition and ensuring effective management of data assets and has very good popularization and application values.

Description

technical field [0001] The present invention relates to the field of computer software, in particular to the field of big data governance, and specifically refers to a method for realizing associated processing of data standards and data quality based on metadata in big data governance. Background technique [0002] With the rapid development of big data technology, more and more enterprises have begun to pay attention to their own data issues, and have begun to use certain means to control data in enterprise data management and data planning, such as using metadata systems to manage enterprise metadata, or Adopt a data quality system to identify problem data of the enterprise, improve data quality, or hire a consulting firm to help the enterprise sort out data standards. To a certain extent, these methods can help enterprises improve data quality and achieve the effect of data governance. However, with the accelerated pace of enterprise information construction, enterprises...

AI Technical Summary

Problems solved by technology

The source of its data standards is metadata, and metadata comes from the databases of various business systems. Therefore, it is necessary to ensure that the databases of each business system are constructed in full accordance with enterprise standards. The data standards produced will become meaningless, and the corresponding data quality will also lack authenticity and usability.

Images