Benjamin Bossan

TST: torch compile tests

3

Right now, we don't have specific tests for torch.compile. Instead, we have a "hack" that allows to run _all_ tests with `torch.compile` if we set the environment variable `PEFT_DEBUG_WITH_TORCH_COMPILE=1`. This...

### System Info - ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ### Tasks - [...

Creating a card from a template string instead of file

8

I wanted to know if this would be something that could be added: Add a new class method `from_string` (or similar name) to initialize a `ModelCard` when the template is...

from_template silently drops non-matching kwargs

5

As a user, it is surprising to me that I can add any argument to `ModelCard.from_template` only to have them silently being ignored if they don't match the template. To...

ENH Layer/model status shows devices now

2

For each adapter, show all the devices of this adapter's parameters. Also, while working on this, found a very minor bug in VeRA as its linear layer didn't implement its...

FIX Allow same layer adapters on different devices

2

Resolves #1639 The issue is that so far, we made the assumption in PEFT that all adapter weights of a specific layer are on the same device. There can be...

Fix error in HF code in README

1

Fixes a small error in the HF download code snippet. There are PRs for the same fix on the corresponding HF Hub model cards. Ping @osanseviero

Potential improvements for evaluation

1

Thanks for providing the code for this promising research. I'm looking forward to see how far this idea can be pushed. It would be especially cool if a heuristic could...

Refactor DoRA to make it work with FSDP

1

## Description With only a few changes, I managed to get DoRA running with FSDP. ## Implementation The first secret ingredient was to not use `lora_B.weight @ lora_A.weight`, as this...

TST Add regression test for DoRA, VeRA, BOFT, LN Tuning

1

These new methods were added but the regression tests were not extended yet. This PR adds regression tests for these methods. The regression artifacts have been pushed based on PEFT...