Semihal
Semihal
### Model description If I uploaded the model to TGI, should I prepare the text in the required template for the generate query? Or does TGI itself perform this operation...
### What happened? When I use `stream=True` for TGI Endpoint, I always get _eos_token_ at the end. It doesn't seem like it should be like this. Request example: ``` curl...
Custom claim name for PreferredUsername field.
### System Info Version: v.1.4.0 Cargo version: cargo 1.79.0 (ffa9cf99a 2024-06-03) GCC version: 11.4.1 GPU: Compile with CUDA_COMPUTE_CAP=86 on machine without GPU (but with CUDA 12.1). I plan to use...
### Before submitting your bug report - [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions - [X] I'm not able to find...