rasbid comments

Repositories
Issues
Comments

Results 1 comments of


                                            rasbid

Support jinja extra template kwargs (Qwen3 enable_thinking feature), from command line and from client

I've built a server version of this branch and I'm missing the KV cache % usage from the /metrics endpoint. Does anyone know why this is happening? Flags used for...