shallow-vs-deep-alignment
shallow-vs-deep-alignment copied to clipboard
Seeking Compatibility Advice: PEFT LoRA with accelerate==0.27.2
Hi,
First of all, thank you so much for your amazing work on this library! It's been incredibly helpful for my projects, and I really appreciate you making it open-source.
I'm currently using accelerate==0.27.2 and would love to use it with PEFT's LoRA functionality. Could I kindly ask for your advice on:
Is this version of accelerate officially compatible with PEFT's LoRA? If yes, what would be the recommended peft version to pair with it? Thanks!