Daniel Han

Sorry, it won't work with Unsloth - best to use normal HuggingFace for now sorry

Are you all on Colab? Try the new method maybe: ```python %%capture # Installs Unsloth, Xformers (Flash Attention) and all other packages! !pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git" !pip install --no-deps...

@skerit Wait so does the new one I posted work? @subhamiitk @acsankar There is another way which might work: First check if `torch.__version__` is v 2.2 or lower. If yes,...

Great! :)

@lousaibiao No sorry Triton must be used, or there's no 2x faster :(

@lousaibiao Wait you simply just want a slow version? Oh

Oh ok loll well itll take some time - we might take Triton out and make it an optional dependecy

Try installing an older version of Unsloth and xformers

Sadly P4s and P40s @davidngrc @FD1970 will not be supported - older versions maybe - they don't have tensor cores, so it'll be at least 5x slower than a free...

@emuchogu Fantastic!! Would you be interested in adding a PR to say the Readme somewhere (just tack it onto the bottom) - I will then move it into the wiki!!...