Palm1r
Provide different settings for online and offline modes as well as automatic switching between them.
Is your feature request related to a problem? Please describe. Since there are quite chip OpenAI and Claude API etc. options, in most cases it's better to use them instead of small local models (specifically if there is not enough VRAM available). But there are also cases where a user can go offline (during the flight, long train/bus trip etc.). For now I need to replace settings manually each time I go offline.
Describe the solution you'd like
- It would be a good idea to have a mechanism detecting connectivity issue and switching the mode to offline which would use local models.
- By default settings may be treated as follows: offline setting for both Code Completion and Chat may be hidden and derive from the main one (which is online for example), thus it will not affect much the current settings view and plugin behaviour.
- A small additional check box per feature may be shown to the user for expanding the offline mode settings.
Describe alternatives you've considered So far the fastest option I found is that I use local model for Code Completion always. For Chat, when offline, I switch to the Page Assist (Chrome) for chatting. To use Quick Refactoring I still have to change the model.
Additional context There are similar requests to cursor.ai though the solution doesn't look straightforward (according to this source)
Hi, good idea, I thought about it too, at least expereance will improve the creation of custom setups with already selected providers, models templates, between which it will be possible to switch faster. And specifically in this case, not just an offline mod, it can be created better as a reserved setup for a lot of problems with connection or payment or the provider does not respond
