toby-lm

> I've added the LLM [HuggingFaceTextGenInference](https://python.langchain.com/en/latest/modules/models/llms/integrations/huggingface_textgen_inference.html), locally the behavior was as expected, could you check if it's okay on your side? >  I've tried building from the `263-self-hosted-llms-support` branch...

Also experiencing this issue!