void icon indicating copy to clipboard operation
void copied to clipboard

[Feature] Add button "remove context"

Open hardWorker254 opened this issue 7 months ago • 2 comments

Is it possible to add a "remove context" button? The context provided by void("role": "system") is very large and can confuse models such as Smallm and noticeably slows down performance on weak laptops when running llms locally. This is very useful for those who need to complete simple tasks such as "write a binary search" or "what is a queue in python?"

hardWorker254 avatar May 20 '25 18:05 hardWorker254

This is a good suggestion, unclear how long this will remain a problem, but we should probably add an option to simply not use the built-in system message and only use .voidrules. Anyone want to add this? Can probably just ask Gemini or Claude to add a new globalSetting in voidSettingsService.ts, a toggle for it in Settings.tsx, and incorporate it in convertToLLMMessageService.ts

andrewpareles avatar May 23 '25 07:05 andrewpareles

@andrewpareles Could you please check my PR https://github.com/voideditor/void/pull/661, I tried implementing this.

animeshlego5 avatar May 24 '25 14:05 animeshlego5

@animeshlego5 I've compiled void from the source code, taking into account your fixes, and it works just divine on a low-power laptop. Thank you so much!

hardWorker254 avatar May 27 '25 15:05 hardWorker254

I'm glad to hear that @hardWorker254 :)

animeshlego5 avatar May 27 '25 15:05 animeshlego5