cloud-pipeline icon indicating copy to clipboard operation
cloud-pipeline copied to clipboard

Pipeline Run: Add possibility to defile pipeline run results as a list of artefacts on a data storage

Open SilinPavel opened this issue 8 months ago • 0 comments

Background For visibility and common usability it can be very good to have possibility to define results of the runs as an explicitly defined list of objects.

Let's introduce an API for this.

Approach

  • New entity (permissions should be nested from run) PipelineRunResult should be introduced:

    {
       "id": <long, PK>,
       "runId": <long, FK on PipelineRun>
       "name": <string>,
       "pattern": <string>, # pattern to match items for this result object
       "items": [ <data storage link> ]
    }
    
  • DataStorageRule object should be changed:

    • Add flag to mark it as run result
    • Add field name
  • During download_outputs in launch.sh additionally publish file as run result if it matches a run result rule

SilinPavel avatar Feb 05 '25 15:02 SilinPavel