dstoolkit-mlops-databricks
dstoolkit-mlops-databricks copied to clipboard
First Time Creation of Databricks Custom Role
Concurrent Jobs will initially see no Role, and create it. When creating it, an error will follow if a current job has created the Role in the interim.
Short term fix is to run the pipeline again when it fails (first time).
Long term fix - remove Role Creation from the concurrent pipelines