Soufiane Chami

it would be great to have pipeline plot for every template

1

It will make it easier to understand which template someone wants to use

Using FastChat UI to Compare Multiple Local LLMs

1

It's not clear in the repo readme how I can use the FastChat UI to compare multiple LLMs on my local machine. I have these models served via FastAPIs and...

Allow custom OpenAI ENDPOINT & Model Names - e.g. Sambanova API Cloud

1

I am trying to use Sambanova API which is compatible with OpenAI SDK. Would love to see how fast inference can benefit here and also use open source LLMs. Below...