continue icon indicating copy to clipboard operation
continue copied to clipboard

Autocomplete fails with gpt-4o (and possibly other models) behind proxy

Open Heap0017 opened this issue 1 year ago • 3 comments

Before submitting your bug report

Relevant environment info

- IDE: VSCode
- Model: gpt-4o via LiteLLM
- config.json:
  
  {
      "provider": "openai",
      "apiBase": "http://localhost:4000",
      "model": "azure/GPT4o"
    }

Description

gpt-4o (and possibly other models) cannot be used for Autocomplete behind a proxy such as LiteLLM. The requests fail because too many (>4) stop words are supplied.

See also https://github.com/continuedev/continue/issues/1371

To reproduce

Proxy gpt-4o using LiteLLM. Try to use this model for autocompletion using provider openai.

Log output

No response

Heap0017 avatar Jul 24 '24 11:07 Heap0017