unsloth
unsloth copied to clipboard
Conda installation instructions
Xformers only supports torch 2.2.0 and not torch 2.2.1: UPDATE Xformers supports 2.2.1!!
Replace conda with mamba if you have it. Much much faster.
conda create --name unsloth_env python=3.10
conda activate unsloth_env
conda install pytorch cudatoolkit torchvision torchaudio pytorch-cuda=<12.1/11.8> -c pytorch -c nvidia
conda install xformers -c xformers
pip install bitsandbytes
pip install "unsloth[conda] @ git+https://github.com/unslothai/unsloth.git"