Max Shawabkeh issues

Repositories
Issues
Comments

Results 1 issues of


                                            Max Shawabkeh

select() on first assistant token broken (in different ways in Mistral and Llama). Likely tokenization issue.

Below is simple code with the output, showing that Llama and Mistral choose a clearly nonsensical first token in `select()` depending on whether the assistant message contains a leading space,...

await-response