cody icon indicating copy to clipboard operation
cody copied to clipboard
verified publisher icon sourcegraph

CODY-5428: pre-warm prefill cache when user switches between files

Open fengzhou-sg opened this issue 11 months ago • 0 comments

When user opens a new file, send auto-edit request (but reject the results) to warm-up LLM prompt cache, so that subsequent requests (on the same file) will have shorter prefill time.

Test plan

  • manual testing

fengzhou-sg avatar Mar 21 '25 16:03 fengzhou-sg