Daniel Han

OOO I like this bash script!! Ye I'm working on fixing Colab for now :(

@tohrnii It's mainly torch 2.2.1 causing issues for multiple packages. I found: ```bash # RTX 3090, 4090 Ampere GPUs: pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git" pip install --no-deps packaging ninja einops...

@HailamAICT I think maybe you forgot to call `FastLanguage.get_peft_model` :)

@tolas92 @medhasreenivasan Hey! Sorry on the delay! I can reproduce this error - Colab seems to have updated some of their packages, causing Colab to break - working on a...

A temporary fix is instead of doing `unsloth[colab] @ git+https://github.com/unslothai/unsloth.git`, do the following: ```bash !pip install "https://download.pytorch.org/whl/cu121/xformers-0.0.24-cp310-cp310-manylinux2014_x86_64.whl" --no-deps !pip install --upgrade transformers datasets sentencepiece tyro !pip install --upgrade bitsandbytes accelerate...

Ok looks like I fixed it! The new section at the top will be: ```python %%capture import torch major_version, minor_version = torch.cuda.get_device_capability() # Must install separately since Colab has torch...

@koleshjr Oh no how are you doing inference? On Colab? Did you manage to use the new install instructions in our Colab notebooks?

@koleshjr Would you happen to have a screenshot of the erro?

No problems at all!

@reneric Oh great you solved the issue!