Autocomplete causes input delay

[stefan-girlich]

Relevant environment info

- OS: MacOS 14.5, MBP M1
- Continue version: 0.9.269 / 0.8.68
- IDE version: VS Code 1.97.2
- Model: qwen2.5-coder:1.5b via Ollama (but choice of model does not make a difference)
- config:
  
  "tabAutocompleteModel": {
    "title": "Tab Autocomplete Model",
    "provider": "ollama",
    "model": "qwen2.5-coder:1.5b"
  },

Description

When autocomplete is active, it causes delays between keyboard input and characters appearing in the editor. Typing feels sluggish and unresponsive. Suggestions from IntelliSense take seconds to appear instead of fractions of a second.

The issue disappeared when deactivating Autocomplete. The issue did not disappear when restarting VS Code.

This issue seemingly existed only on v0.9.269, but not on v0.8.68. But: Switching to v0.8.68 and back to v0.9.269 fixed the issue, so I assume the root cause could be about a cached state that would be reset when switching versions (and restarting extensions).

To reproduce

1. Type in a TypeScript file in the editor

Log output

no log output in dev tools in VS Code while typing

[stefan-girlich]

Update: The issue is back after a few minutes of usage, using 0.9.269. Delay is roughly 0.2s between keystroke and output. If I type ~20 letters, delays queue up and I can watch letters appear in the editor bit by bit.

The issue persists after stopping Ollama (while keeping Autocomplete on).

Right now, the circular progress indicator next to "TypeScript" in the bottom bar is active indefinitely, for minutes now. I wonder if this means that Autocomplete interferes with IntelliSense.

I will switch to v0.8.x and see if this changes anything.

Update #2: The issue persists with v0.8.x

[xeinebiu]

Update: The issue is back after a few minutes of usage, using 0.9.269. Delay is roughly 0.2s between keystroke and output. If I type ~20 letters, delays queue up and I can watch letters appear in the editor bit by bit.

The issue persists after stopping Ollama (while keeping Autocomplete on).

Right now, the circular progress indicator next to "TypeScript" in the bottom bar is active indefinitely, for minutes now. I wonder if this means that Autocomplete interferes with IntelliSense.

I will switch to v0.8.x and see if this changes anything.

Update #2: The issue persists with v0.8.x

For me, this happens only on pre-release version.

[fnimick]

Interesting, I am also on an M1 mac and had this issue with the release version, switching to pre-release appears to have resolved it.

[stefan-girlich]

A friend tried out the same same setup on a MacBook Pro with an M2 Max chip, so at least it's possible to overcome the issue with more computation power.

[qinlinwang]

Update: The issue is back after a few minutes of usage, using 0.9.269. Delay is roughly 0.2s between keystroke and output. If I type ~20 letters, delays queue up and I can watch letters appear in the editor bit by bit.

The issue persists after stopping Ollama (while keeping Autocomplete on).

Right now, the circular progress indicator next to "TypeScript" in the bottom bar is active indefinitely, for minutes now. I wonder if this means that Autocomplete interferes with IntelliSense.

I will switch to v0.8.x and see if this changes anything.

Update #2: The issue persists with v0.8.x

I hava the same problem. This issue becomes even more severe, especially when deleting letters. You can pay attention to the area marked by the red box in the image below. I hope this image can help pinpoint the issue.

[Patrick-Erichsen]

Thanks for the +1s here all - we've had some other reports of autocomplete freezing JetBrains IDEs as well so my hunch is this is related. Will dig into it soon 👍

[qinlinwang]

Thanks for the +1s here all - we've had some other reports of autocomplete freezing JetBrains IDEs as well so my hunch is this is related. Will dig into it soon 👍

I think it may be caused by getDiffSnippets in large project. When i change racePromise(getDiffSnippets(ide)), to [], this issue disappears in VsCode.

[fnimick]

This would also explain why the problem appears to get worse the longer I work without committing.

[A-Yaskevich]

1.1.3 version for VS Code also freezes if there is a lot of uncommited code. After I run commit - everything becomes smooth. But that is kind of a dirty workaround.

[github-actions[bot]]

This issue hasn't been updated in 90 days and will be closed after an additional 10 days without activity. If it's still important, please leave a comment and share any new information that would help us address the issue.

[stefan-girlich]

In my case, the issue is related to the Vim extension (vscodevim.vim, v1.30.1). The problem of sluggish (~100ms delay after keystroke) inputs immediately disappears after either disabling Continue autocomplete or disabling the Vim extension.

@Patrick-Erichsen fyi

[github-actions[bot]]

This issue hasn't been updated in 90 days and will be closed after an additional 10 days without activity. If it's still important, please leave a comment and share any new information that would help us address the issue.

[github-actions[bot]]

This issue was closed because it wasn't updated for 10 days after being marked stale. If it's still important, please reopen + comment and we'll gladly take another look!