61 results about "Data lineage" patented technology

Provided are techniques for viewing data lineage of objects. A data lineage view that includes at least one data lineage path is displayed. The data lineage view is generated by a data lineage tool that tracks an original object through processes that touched that original object. The at least one data lineage path is generated from the original object to a selected object and indicates how the original object was affected by the processes. The data lineage view is displayed as a fish eye view.

Resources for data lineage discovery, data lineage analysis, role-based security, notification. The resources may include or involve machine readable memory that is configured to store a technical data element (“TDE”); a receiver that is configured to receive a query for data lineage information corresponding to a business element identifier; and a processor configured to: register a logical association between the business element identifier and the TDE; and formulate the data lineage information of the TDE associated with the business element identifier. The receiver may be configured to receive a criterion that is required to access one or more technical data elements (“TDEs”) associated with the business element identifier. The receiver may be configured to receive an election to receive a notification of a change of data lineage. The processor may be configured to toggle between a first data lineage graph and a second data lineage graph.

Presenting data lineage information by assigning a score to a data asset along a path between a data source and a data destination, where a predefined scoring function is applied to a characteristic of the data asset, and presenting via a computer-controlled output medium a description of the data source, the data destination, and the path between the data source and the data destination, where the description includes the data asset if the score meets predefined inclusion criteria.

A data processing system configured to perform: obtaining a first data lineage representing relationships among physical data elements, the first data lineage being generated at least in part by performing at least one of: (a) analyzing source code of at least one computer program configured to access the physical data elements; and (b) analyzing information obtained during runtime of the at least one computer program; obtaining, based on user input, a second data lineage representing relationships among business data elements; obtaining an association between at least some of the physical data elements of the first data lineage and at least some of the business data elements of the second data lineage; and generating, based on the association between the physical data elements and the business data elements, an indication of agreement or discrepancy between the first data lineage and the second data lineage.

A system for providing data lineage information for data warehouse objects, the system including a plurality of job descriptions, a log for recording operational information of any of the jobs when any of the jobs are run, a plurality of schemas of databases accessed by the jobs, and a binding service configured to combine information from the job descriptions, the log, and the schemas to provide a data lineage for a data object of a data warehouse.

Techniques are disclosed for capturing and visualizing data lineage in content management systems. For example, a method comprises the following steps. A plurality of data sets is received. Each of the data sets is associated with a party and comprises a plurality of information. A set of lineage data about one or more of the data sets is received. The lineage data comprises information about the history of a particular data set. A user interface is presented that conveys a representation of one or more of the plurality of received data sets and at least a portion of the lineage data about the history of one or more of the data sets. A command is received at the user interface to merge or unmerge two data sets in the plurality of data sets. Two or more data sets in the plurality of data sets are merged or unmerged based on the received command.

A method includes receiving information indicative of an output dataset generated by a data processing system; identifying, based on data lineage information relating to the output dataset, one or more upstream datasets on which the output dataset depends; analyzing one or more of the identified one or more upstream datasets on which the output dataset depends. The analyzing includes, for each particular upstream dataset of the one or more upstream datasets, applying one or more of: (i) a first rule indicative of an allowable deviation between a profile of the particular upstream dataset and areference profile for the particular upstream dataset, and (ii) a second rule indicative of one or more allowable values or prohibited values for each of one or more data elements in the particular upstream dataset, and based on the results of applying the one or more rules, selecting one or more of the upstream datasets. The method includes outputting information associated with the selected oneor more upstream datasets.

Tracking lineage of data. A method may be practiced in a network computing environment including a plurality of interconnected systems where data is shared between the systems. A method includes accessing a dataset. The dataset is associated with lineage metadata. The lineage metadata includes data indicating the original source of the data, one or more intermediary entities that have performed operations on the dataset, and the nature of operations performed on the dataset. A first entity performs an operation on the dataset. As a result of performing a first operation on the dataset, the method includes updating the lineage metadata to indicate that the first entity performed the operation on the dataset. The method further includes providing functionality for determining if the lineage metadata has been compromised in that the lineage metadata has been at least one of removed from association with the dataset, is corrupted, or is incomplete.