Badis
Badis
>But still, even with those "slow" models I have I can get 10 tokens/s on ooba's webui, so it means there's a way to get the same speed on KoboldAI...
Isn't there a way to stop this with that stoping_criteria? https://github.com/oobabooga/text-generation-webui/pull/189
@catalpaaa can you tell us exactly how you proceed to make it stop skizo? I'm tired of having to stop Vicuna everytime he gives me an answer 😅