OKERE

try and download a ggml version of the model should probably work except the model is pygmalion

> i dont understand how this is done im sorry im still a noob to this stuffim using the vicuna model and want it to stop output after the response...

try the kobold api

localhost:5000/api/v1/generate

doesnt as far as i know