flyte
flyte copied to clipboard
[Core feature] Make execution_id and execution_domain available for plugins
Motivation: Why do you think this is important?
BACKGROUND
https://flyte-org.slack.com/archives/CP2HDHKE1/p1741181647724639
ISSUE
We are trying to fetch Flyte execution domain in a Spark task running in Databricks using the Fyte Databricks plugin.
We tried to use the same method that works well in Python tasks running on K8s (flytekit.current_context().execution_id.domain)
Unfortunately, this approach does not work in case of Databricks plugin. It would be nice to pass this info in the API so that we can access it in tasks.
Goal: What should the final outcome look like, ideally?
We are able to fetch execution domain in tasks.
Describe alternatives you've considered
Pass the domain as workflow input param.
Propose: Link/Inline OR Additional context
No response
Are you sure this issue hasn't been raised already?
- [x] Yes
Have you read the Code of Conduct?
- [x] Yes
#take
#take