Local-LLM-Comparison-Colab-UI icon indicating copy to clipboard operation
Local-LLM-Comparison-Colab-UI copied to clipboard

Published 20 hours ago • verified publisher icon Troyanovsky

ImportError: libcudart.so.12

Open niknoproblems opened this issue 1 year ago • 2 comments

when I tried to run Mistral-7B-OpenOrca (using oobabooga/text-generation-webui)Ж ImportError: libcudart.so.12: cannot open shared object file: No such file or directory

niknoproblems avatar Oct 24 '23 18:10 niknoproblems

It was solved when I commented out these lines: !pip uninstall flash-attn !pip install --no-build-isolation flash-attn==2.3.0

niknoproblems avatar Oct 24 '23 19:10 niknoproblems

You can also roll forward to version 2.3.3.

!pip uninstall flash-attn
!pip install --no-build-isolation flash-attn==2.3.3

gleitz avatar Nov 03 '23 19:11 gleitz