Samuel Sithakoul
Samuel Sithakoul
If the model you want to use has safetensors weights on its huggingface space, it will by default use the safetensors weights if the model is loaded in a conventional...
Features from the submod itself can only work on CPUs or on NVIDIA GPUs. It is possible to run `text-generation-webui` with AMD GPU by setting up the correct configuration. However,...
The project seems to be no longer maintained and I believe it's quite out of the scope of MonikA.I. submod as it involves using a completely different outdated repository and...
It seems like an error on `text-generation-webui` side. Did you install it correctly with the instructions on its github [page]( https://github.com/oobabooga/text-generation-webui?tab=readme-ov-file#downloading-models) ?
I've checked on their github and the issue seems to be recent, maybe try to use an older version of `text-generation-webui`.
Huggingface isn't a Webui but indeed hosts a lot of AI models, there is the possibility for testing models in spaces but I don't believe they are made to be...
Did you download the chatbot model as explained in the wiki page [here](https://github.com/Rubiksman78/MonikA.I/wiki/Install-Local-Chatbots-locally/52bd002e54f749a9f15a8264e0bbdb594cb3e84b) ? The current setup of chatbots is currently being completely changed but if you want to use...
The new setup isn't ready yet with text-generation-webui. However, if you put the whole folder for the Pygmalion model in `chatbot_models`, it should work with the current version.
The setup of CUDA is indeed important if you're trying to use local chatbots but it is not related to the previous error which was about a missing file from...
Okay then continue to follow the previous link about the installation of CUDA and don't forget to run `setup_gpu.bat` in last before running it again.