Azure Databricks Pyspark Support

[roshmath]

Hi, Just wondering if this would work with resizing azure databrick clusters!

[calio]

Hi roshmath, Fiber doesn't support azure databrick clusters (yet). We want to hear from the community how much need there is for each of the platforms and prioritize our resources on the platform that are most requested.

At the same time, we also welcome contributions from the community. Adding a new backend for fiber isn't that hard, here is an example of how Kubernetes are supported in Fiber: https://github.com/uber/fiber/blob/master/fiber/kubernetes_backend.py

[roshmath]

Sounds great, thank you!