elyra icon indicating copy to clipboard operation
elyra copied to clipboard

Add ability to map data S3/COS buckets to pipeline nodes

Open lresende opened this issue 4 years ago • 0 comments

When performing large workloads, it does not make sense to use node inputs/outputs to propagate data as it would be very cost-intensive. One idea would be to map an S3/COS bucket to the nodes based on user configuration, which could be node specific or pipeline specific (see #1129)

Also possibly related to #577

lresende avatar Dec 02 '20 23:12 lresende