Jiaxiao Zheng
Jiaxiao Zheng
> So my question is: How to run a TFX job/stage on Kubeflow on multiple "worker" pods, or is that even possible? Currently the answer is no. That said, parallel...
The orchestrator mentioned in the doc mainly refers to the orchestrator that figures out the dependencies of each step in the pipeline and kick off each step in the pipeline...
Sorry for the late response. /cc @zhitaoli to see if there's any Flink expertise available on our side.
I remember there's a very related one in TFX repo: https://github.com/tensorflow/tfx/issues/2618 I am assuming this one is talking about supporting multi-tenancy through k8s-native way -- namespace while that one is...
/assign @Ark-kun Do you know if there's any potential caveat besides caching in this case?
/cc @neuromage To make sure I understand the context correctly, we're talking about the Argo artifact instead of MLMD artifact here, right?