Cannot install on Google Colab

[benjamin-marie]

Please check that this issue hasn't been reported before.

• [X] I searched previous Bug Reports didn't find any similar reports.

Expected Behavior

axolotl should be installed.

Current behaviour

When I ran the installation command on Google Colab (L4 GPU): !git clone https://github.com/axolotl-ai-cloud/axolotl.git !cd axolotl && pip3 install packaging ninja && pip3 install -e '.[flash-attn,deepspeed]'

It yields:

ERROR: Cannot install None and axolotl because these package versions have conflicting dependencies.

The conflict is caused by: axolotl 0.4.1 depends on torch==2.4.1+cu121 accelerate 0.34.2 depends on torch>=1.10.0 bitsandbytes 0.44.0 depends on torch liger-kernel 0.3.0 depends on torch>=2.1.2 optimum 1.16.2 depends on torch>=1.11 peft 0.13.0 depends on torch>=1.13.0 trl 0.9.6 depends on torch>=1.4.0 xformers 0.0.27 depends on torch==2.3.1

To fix this you could try to:

1. loosen the range of package versions you've specified
2. remove package versions to allow pip to attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Steps to reproduce

Go on Google Colab. Select a GPU instance, e.g. L4 And run the installation commands !git clone https://github.com/axolotl-ai-cloud/axolotl.git !cd axolotl && pip3 install packaging ninja && pip3 install -e '.[flash-attn,deepspeed]'

Config yaml

No response

Possible solution

Update the requirements.

Which Operating Systems are you using?

• [ ] Linux
• [ ] macOS
• [ ] Windows

Python Version

3.10

axolotl branch-commit

main

Acknowledgements

• [X] My issue title is concise, descriptive, and in title casing.
• [X] I have searched the existing issues to make sure this bug has not been reported yet.
• [X] I am using the latest version of axolotl.
• [X] I have provided enough information for the maintainers to reproduce and diagnose the issue.