Brendan King

Ah I see, that makes sense. I can see both meanings as useful as long as they're documented. If there's a document where it would make sense to include this...

Seeing this as well, with bigcode/starcoder, launched with: ``` text-generation-launcher --model-id "bigcode/starcoder" --quantize "bitsandbytes" -p 21042 --max-input-length 4095 --max-total-tokens 4096 ``` Local Install. ``` 2024-03-06T08:21:57.071276Z ERROR compat_generate{default_return_full_text=true compute_type=Extension(ComputeType("1-nvidia-a100-sxm4-80gb"))}:generate{parameters=GenerateParameters { best_of:...

@magwas did you ever get this published to maven central? Sorry if I'm missing something, running into the same issue you fixed

Hi all! I was interested in using the MultiWOZ 2.4 evaluator implemented here. For my understanding, is the implementation in this PR complete & correct, and any remaining changes would...

Thanks all! I can work on the remaining feedback from the open PR, testing, etc, unless someone else would prefer to. I'm also working on a few other things so...

I ran into this issue as well, the problem for me was that the `sql` container in `setup.sh` requires docker compose, so if you don't have that installed, that image...

My test query for `input_query_file`, if it helps: [test_query.json](https://github.com/user-attachments/files/16462885/test_query.json)