continue icon indicating copy to clipboard operation
continue copied to clipboard

FIM return escaping symbols

Open Semihal opened this issue 7 months ago • 7 comments

Before submitting your bug report

Relevant environment info

- OS: MacOS 14.5
- Continue: v0.8.42
- IDE: VSCode 1.90.2
- Model: vLLM (CodeQwen1.5-7B) -> LiteLLM
- config.json:
  
{
  "tabAutocompleteModel": {
    "title": "Autocomplete model",
    "provider": "openai",
    "apiBase": "<endpoint>",
    "apiKey": "<token>",
    "model": "qwen",
    "useLegacyCompletionsEndpoint": true,
    "requestOptions": {
      "verifySsl": false
    }
  },
  "tabAutocompleteOptions":{
    "useSuffix": false,
    "useCache": false,
    "template": "<fim_prefix>{{ prefix }}<fim_suffix>{{ suffix }}<fim_middle> "
  },
  "allowAnonymousTelemetry": false
}

Description

I had broken autocomplete: image

The same model with the CodeGPT plugin for JetBrainns is working properly :(

To reproduce

No response

Log output

No response

Semihal avatar Jul 03 '24 15:07 Semihal