gugeonmo

@vmurahari3, I had a similar issue. In my case 2B worked okay, but 6B was the problem. I figured out that the 6B model was not completely downloaded due to...

Thanks. It worked for me. (my version is cuda 11.7) ``` pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117 pip uninstall flash-attn pip install flash-attn --no-cache-dir --no-build-isolation ```