System for metadata management

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for metadata management. One of the methods includes receiving user input selecting a first node. The method includes receiving a first data lineage of a first object, the first object having a type, the first data lineage describing relationships between the first object and one or more datasets or transforms. The method includes receiving user input selecting a second node. The method includes receiving a second data lineage of a second object, the second object having the same type as the first object. The method includes performing a comparison of the first node and the first data lineage to the second node and the second data lineage. The method includes generating a report based on the comparison.

Description

[0001] priority claim [0002] This application claims priority to US Patent Application 61 / 790,074, filed March 15, 2013, the entire contents of which are hereby incorporated by reference. Background technique [0003] This specification relates to a system for maintaining and comparing versions of a data processing system. [0004] Businesses use sophisticated data processing systems such as data warehouses, customer relationship management, data mining, etc. to manage data. In many data processing systems, data is pulled into a central repository from many different sources such as database files, operating systems, flatfiles, and the Internet. Often, data is transformed before it is loaded into a data system. Transformation can include cleansing, integration and extraction. To keep track of the data, its source, and the transformations that have occurred to the data stored in the data system, metadata can be used. Metadata (sometimes referred to as "data about data") i...

AI Technical Summary

Problems solved by technology

For example, a user may want to know which output tables will be affected if a dataset is modified

Images