Oskar John Hollinsworth
Oskar John Hollinsworth
I was able to fix this by commenting out these two lines: https://github.com/huggingface/peft/blob/ec5a1b2ce62b14925239f62582eb3db5d9174af2/src/peft/tuners/tuners_utils.py#L1458 but I'm not sure if that would break other use cases
> [@ojh31](https://github.com/ojh31) Given the upcoming transformers v5 release and the work associated with that, I didn't have time week to investigate your issue (which can potentially take quite some time...
> Now, to fix the original issue without the problematic code change, could you please try setting `fsdp_cpu_ram_efficient_loading: false` in your FSDP config? This resolved the hanging issue for me...