shallow-vs-deep-alignment icon indicating copy to clipboard operation
shallow-vs-deep-alignment copied to clipboard

Seeking Compatibility Advice: PEFT LoRA with accelerate==0.27.2

Open pokerwf opened this issue 7 months ago • 0 comments

Hi,

First of all, thank you so much for your amazing work on this library! It's been incredibly helpful for my projects, and I really appreciate you making it open-source.

I'm currently using accelerate==0.27.2 and would love to use it with PEFT's LoRA functionality. Could I kindly ask for your advice on:

Is this version of accelerate officially compatible with PEFT's LoRA? If yes, what would be the recommended peft version to pair with it? Thanks!

pokerwf avatar May 05 '25 12:05 pokerwf