SurfSense
SurfSense copied to clipboard
Add LLM Model Selector in UI Itself
Lets Add LLM Model Selector in UI Itself. We already have Connector management system, just need to implement LLM Model management system. I will do it myself. Open to any suggestions.
This is the rough plan for now:
- Add LLMProvider TABLE & assiciate it with user
- Add its crud routes.
- At startup if no llmprovider for this user then redirect to create one. Also let them create more if needed.
- Then Let them select our config vars ie fast, statergic, longconext llms.
- Update all code to use that.
- Add its management UI in User Settings > Settings
- Test
- Let new contributors add remaining providers (These will be good first issues), but I will make sure I have custom fallback to set any LLM in LiteLLM so Users can still add any LLM config.
https://github.com/MODSetter/SurfSense/pull/164
Thanks for this
Thanks for this
Nice. It still need to be tested fully though. LMK if you face any problems configuring a LLM Provider through this.