Arduin Findeis

Great, thanks for the quick response @StellaAthena! > The cohere API does not appear to have anything like the [logprobs](https://platform.openai.com/docs/api-reference/completions/create#completions/create-logprobs) argument in the OpenAI API. Thus, a second greedy API...

@haileyschoelkopf good point about the EOT token being passed, I hadn't noticed this code before! However, for the cohere API, we give the prompt as a string and not as...

That would be brilliant, thanks @LauraRuis! What tests would be good/necessary/recommended to run @haileyschoelkopf? Not familiar enough to make a judgement on this myself.

Thanks for catching this error @LauraRuis, and sorry for the delay! I missed a detail about the `rolling_loglikelihood()` method. The last two commits should fix this issue. I added and...

@LauraRuis thanks for running the test again! That's a quite confusing error! The truncation should be set by the `truncate=self.truncate` option in `client.generate()`. By default I set this to `"START"`...

Thanks @StellaAthena and @LauraRuis for looking into this further! I was able to reproduce the error with an example similar to Laura's. This seems to be a bug inside Cohere's...

Good news: cohere have now confirmed that the bug should be fixed. Some prelim tests on my side confirmed this. @LauraRuis could you try to run the tests again?

Thanks for following up @haileyschoelkopf! We are currently still waiting to hear back from Cohere on their discord, just sent a follow-up reminder myself over there ([you can find the...

Hi @StellaAthena thanks for following-up! I was unable to run further tests at the time for unrelated reasons, and unfortunately no longer have time/capacity to further debug and test this...

@david-woelfle thanks a lot for this great suggestion! Sorry for the late reply here, but I think completely isolating the environment in its own docker container has the potential to...