Denis Jannot

@infa-ddeore can you please attach your config dump ?

@infa-ddeore is it an Istio dump ? Do you have dynamic listeners ?

+1

Yes, exactly. And we provide our own RBAC which is not based on where the objects are created. So, I would say that the namespace used doesn't really matter.

No code change is required. You just need to create a Kubernetes headless service to make sure the extauth server gets the IP addresses of the passthrough Pods.

@molbal this example doesn't show how to use the chat template with the Phi-3 model and the https://github.com/unslothai/unsloth/blob/main/unsloth/chat_templates.py file doesn't include it

Any update @danielhanchen ?

Thanks !

@subash54 do you already have a draft available ? I'd like to understand how to use the backend plugin I'm developing without submitting it.

Thanks @danielhanchen for the fast response (as usual). I did try this, but I now get another error: ``` Traceback (most recent call last): File "/home/denis/Documents/ai/unsloth/llama3-chat-template.py", line 113, in trainer_stats...