continue icon indicating copy to clipboard operation
continue copied to clipboard

(intellij) tab completion outputs too verbose completion "it looks like you are coding(...)" instead of actual code

Open laurentperez opened this issue 6 months ago • 3 comments

Before submitting your bug report

Relevant environment info

- OS:Ubuntu 22.04.4 LTS
- Continue:0.0.62
- IDE:idea
- Model:llama3.1:latest
- config.json:
  
(...)
  "tabAutocompleteModel": {
    "title": "Tab",
    "provider": "openai",
      "model": "llama3.1:latest",
      "apiBase": "http://xxxx:11434"
  },
  "embeddingsProvider": {
    "provider": "ollama",
    "model": "nomic-embed-text" # using local ollama not remote
  }

Description

  • I'm using a remote ollama server hosted on xxxx using llama 3.1
  • I understand this is not using codestral nor starcoder
  • I've read and understood https://docs.continue.dev/features/tab-autocomplete#setting-up-a-custom-model

To reproduce

what happens :

  • I code, then I tab
  • tab autocompletes but it does not complete with code, it completes with a "human guided" output like "it looks like you are coding(...)"
  • I'd prefer to complete with a code block, and not a verbose description of what the LLM understands about my current state

how could I set a custom systemMessage for the tab completion ? I'd like something similar to this : "just output the code, be concise".

setting systemMessage in tabAutocompleteModel seems to have no effect at all.

is it even the right scenario here, or instead of llama3.1 should I just use starcoder ? I can't use codestral, I don't want my prompts to be sent to Mistral.

Log output

No response

laurentperez avatar Aug 26 '24 10:08 laurentperez