autoawq 0.2.6 causing conflicting dependencies

[Mr-Jeffery]

Please check that this issue hasn't been reported before.

• [X] I searched previous Bug Reports didn't find any similar reports.

Expected Behavior

I created a conda envirnoment with python==3.11 and torch==2.1.1+cu118 and conduct installation as readme guided, but the conda shows dependency conflicts.

Current behaviour

autoawq 0.2.6 depends on torch==2.3.1, thus can not work with torch==2.1.1

ERROR: Cannot install None, axolotl and axolotl[deepspeed,flash-attn]==0.4.1 because these package versions have conflicting dependencies.

The conflict is caused by:
    axolotl 0.4.1 depends on torch==2.1.1+cu118
    accelerate 0.32.0 depends on torch>=1.10.0
    bitsandbytes 0.43.3 depends on torch
    optimum 1.16.2 depends on torch>=1.11
    peft 0.12.0 depends on torch>=1.13.0
    trl 0.9.6 depends on torch>=1.4.0
    axolotl[deepspeed,flash-attn] 0.4.1 depends on torch==2.1.1+cu118
    deepspeed 0.14.4 depends on torch
    flash-attn 2.6.2 depends on torch
    autoawq 0.2.6 depends on torch==2.3.1

Steps to reproduce

conda create -n axolotl python==3.11
conda activate axototl
pip3 install torch==2.1.1+cu118 --extra-index-url https://download.pytorch.org/whl/cu118 --no-cache-dir

git clone https://github.com/axolotl-ai-cloud/axolotl
cd axolotl

pip3 install packaging ninja
pip3 install -e '.[flash-attn,deepspeed]'

Config yaml

No response

Possible solution

We might need to change the autoawq>=0.2.5 to autoawq==0.2.5

Which Operating Systems are you using?

• [X] Linux
• [ ] macOS
• [ ] Windows

Python Version

3.11

axolotl branch-commit

main/70978467a088da3abf3fe45d92d90f6529f19ea9

Acknowledgements

• [X] My issue title is concise, descriptive, and in title casing.
• [X] I have searched the existing issues to make sure this bug has not been reported yet.
• [X] I am using the latest version of axolotl.
• [X] I have provided enough information for the maintainers to reproduce and diagnose the issue.