TimyIsCool

Results 17 comments of TimyIsCool

doesnt work > Referenc

Change var API = WebURL + "http:/ip:4000/api/"; to var API = "http://ip:port/api/";

Change var API = WebURL + "http:/ip:4000/api/"; to var API = "http://ip:port/api/";

I see that you have var API = "http://192.168.1.8:4000/" + "api"; Change it to var API = "http://192.168.1.8:4000/"

trying to run SRMD*

But i need to build my own image

Is there anything I can do to improve performance on the P40? Also is there any way to lower normal ram usage?

Doesn't all pascal cards, older and maybe turning cards have bad FP16 performance?

![image](https://github.com/turboderp/exllama/assets/74112751/da66b461-4d9c-4c3e-bca6-9eb968dde827) (First spike is it normally) My P40 gets stuck every other message and then sillytavern times it out, I get about 3.7 tokens a second (On AVG) but it...