justinchiu-cohere

Results 4 comments of justinchiu-cohere

[Bug]: "timeout" and "stream_timeout" set at the model level in config.yaml do not work

any idea how this was fixed? getting mysterious timeouts -> retries with an oai-compatible server using aider as well the issue seemed to be that the timeout in aider benchmarking...

[Bug]: "timeout" and "stream_timeout" set at the model level in config.yaml do not work

Hey! The timeout messages interestingly did not return those values, so I couldn't find where they were in the litellm codebase. Messages: ``` litellm.Timeout: Timeout Error: OpenAIException - stream timeout...

[Bug]: "timeout" and "stream_timeout" set at the model level in config.yaml do not work

Yes, it looks like aider uses the sync completions in general: https://github.com/Aider-AI/aider/blob/main/aider/models.py#L982

Function calling command parsing: tuple of ints gets turned into string

ive run into this for a bunch of models as well. the edit_anthropic view_range tool description seems a bit confusing too. is the expected input supposed to be a string:...