KoboldAI
How to use
Is there any information available on how to use the AI once the repo has been cloned and the dependencies installed ? I downloaded some pytorch_model.bin files from HuggingFace following the links given in README, it took a day and a half, now what do I do with them ? The menu in "AI > Load a model from its directory" doesn't recognize when I put the file in the model/ folder and type the name of the file then, it even tries to download something from HuggingFace for some reason - as if I had not clicked "Load a model from its directory"... 🤷
The easiest way is to put the huggingface model name in the field that is in the directory so that Kobold can take care of the downloading. But if you have already downloaded a model make sure to make a subfolder for it inside the models folder and then place the files inside that. It will need more than just the pytorch_model.bin, it also needs the tokenizer and config.
