unsloth
unsloth copied to clipboard
Follow typical conda install but xformer and bitsandbytes fail on A100
root@A100:/aml/conda/lib/python3.10/site-packages# python -m xformers.info
Traceback (most recent call last):
File "/aml/unsloth_env/lib/python3.10/runpy.py", line 187, in _run_module_as_main
mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
File "/aml/unsloth_env/lib/python3.10/runpy.py", line 110, in _get_module_details
import(pkg_name)
File "/aml/conda/lib/python3.10/site-packages/xformers/init.py", line 9, in
My operations history
conda create --prefix /aml/unsloth_env python=3.10
2047 conda update -n base -c defaults conda
2048 conda install conda=24.3.0
2049 conda create --prefix /aml/unsloth_env python=3.10
2050 conda activate /aml/unsloth_env
2051 conda install pytorch-cuda=12.1 pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers
2052 pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
2053 pip install --no-deps trl peft accelerate bitsandbytes
@hellangleZ Apologies on the delay - I'm assuming removing dataclasses
could help?