xiscoding

You need to log into hugging face for this and the format isn't right for the text-generation-webui unfortunately... I didn't get it to actually run though so there is probably...

> You can try to reduce the "max_batch_size" at row 44 of example.py > > `model_args: ModelArgs = ModelArgs(max_seq_len=1024, **max_batch_size=8**, **params)` This worked and reduced VRAM for one of my...

I can not find torch/all.h or torch/python.h my fault

I just need to find the torch/all.h and torch/python.h files and put the full path in the include (#include ***NOT FOUND #include ***NOT FOUND #include ***FOUND somehow I cant find...

Holy cow I am a fool I forgot to set visible devices... I have a 960 that does not support 8bit quantization... `CUDA_DEVICE_ORDER="PCI_BUS_ID" CUDA_VISIBLE_DEVICES="0,2" python setup_cuda.py install` set the visible...

I am garbage at node.js but if it looks like the query is incorrect. Do you know how to change the query? Server running on http://localhost:3000/ > query: { method:...

ok so this runs in the terminal but does not run in the webUI... I know am missing something basic here const Dalai = require('dalai'); new Dalai().request({ model: "65B", prompt:...

No the code I posted above works just the webui does not work with it. There are instructions to make the webui but I do not have time to learn...

> The issue is the website defaults to `7B` and only updates the value when you have a change event on the drop down. Since there's only one item in...

I think you have to use the api. If not can you show how you made it work without. I have installed dalai and still see this: Server running on...