infinite-sides
infinite-sides copied to clipboard
Error with koboldcpp
Describe the bug When trying to connect the program to koboldcpp's API (localhost:5001/v1) it throws an error.
To Reproduce Install infinite-sides as normal, then launch a .gguf model with koboldcpp and try to connect infinite-sides to the API address of koboldcpp.
Expected behavior infinite-sides should connect to koboldcpp and display the currently running model in the selection menu.
Screenshots
Desktop (please complete the following information):
- OS: Windows