[FR] Add support and examples for common LLM backends

[svilupp]

It would be great to add support and examples on how to use common LLM backends/providers, eg,

• [ ] vLLM
• [ ] LMStudio
• [ ] HuggingFace Transformers
• [ ] SGLang
• [x] Databricks
• [ ] koboldcpp

See the full list here

[pabvald]

I would like to add support for Azure OpenAI.

[svilupp]

@pabvald that should already be possible. Have you seen this FAQ: https://siml.earth/PromptingTools.jl/dev/frequently_asked_questions#Using-Custom-API-Providers-like-Azure-or-Databricks ?

It’s like Databricks and everyone has a little bit different URL, so you just need to provide your details.