unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

Follow typical conda install but xformer and bitsandbytes fail on A100

Open hellangleZ opened this issue 10 months ago • 2 comments

root@A100:/aml/conda/lib/python3.10/site-packages# python -m xformers.info Traceback (most recent call last): File "/aml/unsloth_env/lib/python3.10/runpy.py", line 187, in _run_module_as_main mod_name, mod_spec, code = _get_module_details(mod_name, _Error) File "/aml/unsloth_env/lib/python3.10/runpy.py", line 110, in _get_module_details import(pkg_name) File "/aml/conda/lib/python3.10/site-packages/xformers/init.py", line 9, in import torch File "/aml/conda/lib/python3.10/site-packages/torch/init.py", line 1309, in from ._tensor_str import set_printoptions File "/aml/conda/lib/python3.10/site-packages/torch/_tensor_str.py", line 12, in class __PrinterOptions: File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 958, in dataclass return wrap(_cls) File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 950, in wrap return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen) File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 800, in _process_class cls_fields = [_get_field(cls, name, type) File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 800, in cls_fields = [_get_field(cls, name, type) File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 659, in _get_field if (_is_classvar(a_type, typing) File "/aml/conda/lib/python3.10/site-packages/dataclasses.py", line 550, in _is_classvar return type(a_type) is typing._ClassVar AttributeError: module 'typing' has no attribute '_ClassVar'. Did you mean: 'ClassVar'?

hellangleZ avatar Apr 20 '24 02:04 hellangleZ

My operations history
conda create --prefix /aml/unsloth_env python=3.10 2047 conda update -n base -c defaults conda 2048 conda install conda=24.3.0 2049 conda create --prefix /aml/unsloth_env python=3.10 2050 conda activate /aml/unsloth_env 2051 conda install pytorch-cuda=12.1 pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers 2052 pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git" 2053 pip install --no-deps trl peft accelerate bitsandbytes

hellangleZ avatar Apr 20 '24 02:04 hellangleZ

@hellangleZ Apologies on the delay - I'm assuming removing dataclasses could help?

danielhanchen avatar Apr 21 '24 17:04 danielhanchen