AzureDatabricksBestPractices icon indicating copy to clipboard operation
AzureDatabricksBestPractices copied to clipboard

Guidance for scheduled jobs needs updating

Open TheRealJimShady opened this issue 2 years ago • 0 comments

What has been written to date is mostly still correct but the guidance could be expanded to include log and metric isolation as a key reason to favour jobs compute clusters over all-purpose compute clusters for scheduled jobs. Additionally, the instance pools feature is referenced as something that 'will' reduce startup time for short, frequent jobs - this has since been released into GA and should be reflected as such 🙂

TheRealJimShady avatar Jun 24 '22 13:06 TheRealJimShady