Benjamin Bossan

Hi, this is the Hugging Face PEFT package and it has nothing to do with PyTorch Lightning. Please ask this question in their forums or create a GitHub issue on...

Works for me with Firefox 124.0.2 (Ubuntu). 

Very strange. I tried another Ubuntu machine with Firefox and it renders fine there as well. Incognito mode has no effect.

> By trying incognito I meant to signal that it's not due to an impact of some FF extension, since incognito disables them all. Got it. > But if it's...

I just want to let you know that I'm still investigating, this issue is not forgotten :) It's just not that easy understanding what goes on under the hood with...

**Update**: DoRA and QDoRA training with FSDP should be fixed in #1806. If you install from the latest PEFT main, it should thus work. Please also check the PR description...

_not stale_

Good idea training on that dummy dataset to debug what's happening. Do you see any model progress at all or is the output basically static? Any logs you can share...

I see. Could you please paste your complete python code so that we can try to replicate the issue? @younesbelkada Can you see anything wrong with the shown code?

> This might be the problem. Try "all-linear" Note that this is only an issue if the model is not one of the [pre-configured models](https://github.com/huggingface/peft/blob/8bc3c0861d4a06d1501b5e8954079804419bb0e6/src/peft/utils/constants.py#L48). If there is no matching...