alignment-handbook
alignment-handbook copied to clipboard
Dependency updates for QLoRA+FSDP
For QLoRA+FSDP support, the dependencies should be updated:
bitsandbytes>=0.43.0accelerate>=0.28.0transformers>4.38.2trl>0.7.11peft>0.9.0
Also, it would be wonderful to have accelerate recipe for this too.