cloud-pipeline
cloud-pipeline copied to clipboard
Pipeline Run: Add possibility to defile pipeline run results as a list of artefacts on a data storage
Background For visibility and common usability it can be very good to have possibility to define results of the runs as an explicitly defined list of objects.
Let's introduce an API for this.
Approach
-
New entity (permissions should be nested from run) PipelineRunResult should be introduced:
{ "id": <long, PK>, "runId": <long, FK on PipelineRun> "name": <string>, "pattern": <string>, # pattern to match items for this result object "items": [ <data storage link> ] } -
DataStorageRule object should be changed:
- Add flag to mark it as run result
- Add field
name
-
During
download_outputsinlaunch.shadditionally publish file as run result if it matches a run result rule