continue icon indicating copy to clipboard operation
continue copied to clipboard

Anthropic prompt caching doesn't work

Open s-h-a-d-o-w opened this issue 6 months ago • 2 comments

Before submitting your bug report

Relevant environment info

- OS: Windows 11
- Continue version: 1.1.23
- IDE version: VSCode 1.99.2
- Model: Claude Sonnet 3.5
- config (truncated to what's relevant because my config is >100 lines):
  
  - name: claude-3-5
    provider: anthropic
    model: claude-3-5-sonnet-latest
    apiKey: ...
    cacheBehavior:
      cacheConversation: true
  
  OR link to assistant in Continue hub:

Description

I used the following prompt in Chat on serenade: @Codebase How do we get the information of what the language of the currently open editor in VS Code is?

See below for the resulting requests. (As far as I can see, you do one request for the code base context and then another one for the actual prompt. I don't know where the third request comes from.)

Do you maybe only use caching for the agent?

To reproduce

See description.

Log output

Image Image Image

s-h-a-d-o-w avatar Apr 15 '25 09:04 s-h-a-d-o-w