Renmin
Renmin
for pagination, there is already a ticket in kubeflow/pipelines. @Bobgy for the "Artifact store becomes slower and slower", @jingzhang36 for perf
Any reason why not directly read/write S3? Is it because the libary doesn't support S3 interface?
+1 to Ark-kun's reply. It's better all tasks are built into the pipeline.
/cc jingzhang36
Thanks Amit for driving this feature. It's great feature but it also has the side which would introduce complexity and resource-holding etc. we may didn't aware yet. Here double check...
/cc jingzhang36