egeria-connector-ibm-information-server icon indicating copy to clipboard operation
egeria-connector-ibm-information-server copied to clipboard

Data Stage connector support for high level lienage

Open lpalashevski opened this issue 3 years ago • 7 comments

Latest changes in DE OMAS introduce support for high level (asset) lineage mappings. Sample request:

{
    "processes": [
        {
            "qualifiedName": "(process)=CopyColumnsFlow44",
            "displayName": "CopyColumnsFlow44",
            "name": "CopyColumnsFlow44",
            "description": "CopyColumnsFlow describes high level process input and output and mappings between (sub)processes (if any).",
            "owner": "Platform User",
            "lineageMappings": [
                {
                    "sourceAttribute": "(host)=HOST::(data_file_folder)=home::(data_file_folder)=files::(data_file)=names2.csv",
                    "targetAttribute": "(process)=CopyColumnsFlow44"
                },
                {
                    "sourceAttribute": "(process)=CopyColumnsFlow44",
                    "targetAttribute": "(host)=HOST::(data_file_folder)=home::(data_file_folder)=files::(data_file)=emplname4.csv"
                }
            ],
            "updateSemantic": "REPLACE"
        }
    ],
    "externalSourceName": "(organization)=MyCompany::(project)=DataPlatform"
}

We need to investigate the possibility to add this capability to Data Stage connector as well.

lpalashevski avatar Jun 11 '21 11:06 lpalashevski