Savin
Savin
#992 provides GA support for Kubernetes. https://github.com/outerbounds/metaflow/tree/airflow is tracking the Airflow integration on top of Kubernetes.
[This](https://github.com/outerbounds/metaflow/tree/airflow) branch tracks the work for this issue.
Additionally add `max_workers`, `num_splits` as well - https://outerbounds-community.slack.com/archives/C02116BBNTU/p1629149990116300 accessible through slack.outerbounds.co
@nbertagnolli You can actually [use any `tag` as a namespace](https://docs.metaflow.org/metaflow/tagging#tags-as-namespaces). We don't expose any API currently that can provide you a list of all tags globally but you can check...
@ryan-williams If you can address the comment in the PR, we can merge this in.
@npow Can you expand on your use case for this PR?
That makes sense. This PR would require a bit more thought if we also need to allow overriding of the parameters (set during `step-functions create`) through state-machine triggering as well.
Here is the wider memo around event-triggering - https://docs.google.com/document/d/1liTvpACWKioCSQTUv5iO3g2AKuLu4x3EYFwEl43WAZU/edit. Let me follow up on #840 with the changes needed to move it in the right direction. For this PR, let...
@npow circling back on this - the major issue with this feature is that parameters can potentially overlap with the CLI arguments of `step-functions create` like `workflow-timeout`, `authorize` etc. Given...
@npow any thoughts on the previous comment?