patrickmros
patrickmros
> something like VirusTotal Yeah that was the first thing I've tried. But the file size is to large. I will install a second virus scanner to check the file.
No I haven't used a pagefile, because I didn't need it. The 8-bit version works without a pagefile, does the 4-bit need more DRAM?
That's weird. I checked again and I do have a swap file on my second hard disk. There's 100GB of memory free space and the swap file size is automatically...
> @patrickmros Can you execute this command and give the output? `conda list -p "C:\Users\patri\miniconda3\envs\textgen\"` > > This is only an idea but since you are running cpu generation, can...
> Merged now > > ``` > pip install -r requirements.txt > python download-model.py tloen/alpaca-lora-7b > python server.py --model llama-7b --load-in-8bit > ``` > > Then select the LoRA in...
> Run `pip install -r requirements.txt` I did that. Had to do the 8-bit fix all over again after that and then something else broke and i was so frustrated...
I followed the suggestions above but when i try to run it with 8-bit precision i get an error window pop up "Bad Image python.exe libbitsandbytes_cuda116.dll is either not designed...
> > I followed the suggestions above but when i try to run it with 8-bit precision i get an error window pop up "Bad Image python.exe libbitsandbytes_cuda116.dll is either...