Tuxius

> I did > > ``` > pip install pytorch-lightning==1.5 > ``` > > and it works fine. This worked for me, but only after removing the conda environment, changes...

@ChinaArvin : Thank you, yes following these instruction it works now nicely well below 24 GB. However, having to use WSL feels like a workaround, even though I enjoy Linux...

Same issue with Windows11 32 GB RAM and RTX3090 24 GB VRAM trying to run 7B. Already tried different versions of CUDA and PyTorch without improvement. CPU is not an...