Oskar John Hollinsworth

FSDP QLORA doesn't work with multiple adapters

7

### System Info - `Accelerate` version: 1.10.1 - Platform: Linux-5.15.0-157-generic-x86_64-with-glibc2.39 - `accelerate` bash location: /opt/uv/venv/bin/accelerate - Python version: 3.12.11 - Numpy version: 2.2.6 - PyTorch version: 2.9.0.dev20250825+cu128 - PyTorch accelerator:...

Feature request: FSDP2 QLoRA

1

Quantization is extremely useful and FSDP2 has lots of nice features. It would be great if we could please have the option to do QLoRA so that we can fully...